DMCA
Regression Shrinkage and Selection Via the Lasso (1994)
| Venue: | JOURNAL OF THE ROYAL STATISTICAL SOCIETY, SERIES B |
| Citations: | 3999 - 49 self |
BibTeX
@ARTICLE{Tibshirani94regressionshrinkage,
author = {Robert Tibshirani},
title = {Regression Shrinkage and Selection Via the Lasso},
journal = {JOURNAL OF THE ROYAL STATISTICAL SOCIETY, SERIES B},
year = {1994},
volume = {58},
pages = {267--288}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
We propose a new method for estimation in linear models. The "lasso" minimizes the residual sum of squares subject to the sum of the absolute value of the coefficients being less than a constant. Because of the nature of this constraint it tends to produce some coefficients that are exactly zero and hence gives interpretable models. Our simulation studies suggest that the lasso enjoys some of the favourable properties of both subset selection and ridge regression. It produces interpretable models like subset selection and exhibits the stability of ridge regression. There is also an interesting relationship with recent work in adaptive function estimation by Donoho and Johnstone. The lasso idea is quite general and can be applied in a variety of statistical models: extensions to generalized regression models and tree-based models are briefly described.
Keyphrases
selection via regression shrinkage interpretable model ridge regression interesting relationship tree-based model simulation study usual regression situation linear model new method introduction consider residual sum absolute value lasso idea statistical model quadratic programming regression model adaptive function estimation favourable property recent work
