Open Access Open Access  Restricted Access Subscription or Fee Access

Highlighting the regularization properties of PLS regression using the conjugate gradient algorithm

Abdelmounaim KERKRI, Jelloul ALLAL, Zoubir ZARROUK


The link between partial least squares regression and the conjugate gradient algorithm is well known, the goal of this paper is to prove and explore this link to give a simpler proof that PLS regression is a regularization method. Using the conjugate gradient algorithm we will propose a new formula for the PLS filter factors, one that is less sensitive to rounding off error. Finally we will use a simulation study to illustrate the relationship between the amount of regularization and the optimal mean squared error value obtained with PLS regression.


Linear regression, PLS regression, Regularization, Conjugate gradient

Full Text:


Disclaimer/Regarding indexing issue:

We have provided the online access of all issues and papers to the indexing agencies (as given on journal web site). It’s depend on indexing agencies when, how and what manner they can index or not. Hence, we like to inform that on the basis of earlier indexing, we can’t predict the today or future indexing policy of third party (i.e. indexing agencies) as they have right to discontinue any journal at any time without prior information to the journal. So, please neither sends any question nor expects any answer from us on the behalf of third party i.e. indexing agencies.Hence, we will not issue any certificate or letter for indexing issue. Our role is just to provide the online access to them. So we do properly this and one can visit indexing agencies website to get the authentic information. Also: DOI is paid service which provided by a third party. We never mentioned that we go for this for our any journal. However, journal have no objection if author go directly for this paid DOI service.