Machine learning is a tool that uses a computer’s analytic power to make decisions and predictions from data. Two common machine learning techniques are Least Absolute Shrinkage and Selection Operator (LASSO) and Ridge regression. We provide intuition to identify cases in which a researcher may prefer these models to least squares. We discuss the application, implementation, and uses of LASSO and Ridge regression, relative to (i) each other and (ii) least squares, including splitting the data and the choice of tuning parameter. Further, we use an example to compare least squares, LASSO, and Ridge regression to demonstrate how machine learning techniques select the most important regressors for prediction analysis.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Explaining Ridge Regression and LASSO

  • Katherine Hauck,
  • Tiemen Woutersen

摘要

Machine learning is a tool that uses a computer’s analytic power to make decisions and predictions from data. Two common machine learning techniques are Least Absolute Shrinkage and Selection Operator (LASSO) and Ridge regression. We provide intuition to identify cases in which a researcher may prefer these models to least squares. We discuss the application, implementation, and uses of LASSO and Ridge regression, relative to (i) each other and (ii) least squares, including splitting the data and the choice of tuning parameter. Further, we use an example to compare least squares, LASSO, and Ridge regression to demonstrate how machine learning techniques select the most important regressors for prediction analysis.