Penalized Regression

Abstract

Penalized regression has gained a great popularity in contemporary applications in statistics and data sciences. There are two main domains in statistics where the penalized regression has been regarded as a canonical tool: nonparametric regressions to obtain smooth regression functions for better prediction accuracy and linear regressions with high‐dimensional predictors to have sparse regression coefficients to improve interpretability as well as the prediction accuracy.