Can we beat overfitting?—A closer look at Cloarec's PLS algorithm

Skip to Navigation

EarlyView Article

  • Published: Mar 7, 2018
  • Author: Pedro F. M. Sousa, K. Magnus Åberg

Abstract

Random noise has been addressed as a cause of overfitting in partial least squares regression. A previous study pinpointed that one of the sources of overfitting resides in the calculation of scores due to the accumulation of noise in the diagonal of the variance‐covariance matrix, and a modified partial least squares regression was proposed with the removal of this diagonal prior to the score calculation. Here, a further modification of the NIPALS algorithm is proposed, with the same ability to overcome overfitting due to noise, but algebraically more similar to the original NIPALS. The results indicate that it is possible to get more reliable auto‐prediction R2 with a cross‐validation performance close to that of the original NIPALS algorithm.

Social Links

Share This Links

Bookmark and Share

Microsites

Suppliers Selection
Societies Selection

Banner Ad

Click here to see
all job opportunities

Most Viewed

Copyright Information

Interested in separation science? Visit our sister site separationsNOW.com

Copyright © 2018 John Wiley & Sons, Inc. All Rights Reserved