The use of vector bootstrapping to improve variable selection precision in Lasso models

Abstract

The Lasso is a shrinkage regression method that is widely used for variable selection in statistical genetics. Commonly, K-fold cross-validation is used to fit a Lasso model. This is sometimes followed by using bootstrap confidence intervals to improve precision in the resulting variable selections. Nesting cross-validation within bootstrapping could provide further improvements in precision, but this has not been investigated systematically. We performed simulation studies of Lasso variable selection precision with and without nesting cross-validation within bootstrapping. Data were simulated to represent genomic data under a polygenic model as well as under a model with effect sizes representative of typical GWAS results. We compared these approaches to each other as well as to software defaults for the Lasso. Nested cross-validation had the most precise variable selection at small effect sizes. At larger effect sizes, there was no advantage to nesting. We illustrated the nested approach with empirical data comprising SNPs and SNP-SNP interactions from the most significant SNPs in a GWAS of borderline personality symptoms. In the empirical example, we found that the default Lasso selected low-reliability SNPs and interactions which were excluded by bootstrapping.

Coordinated Cellular Neighborhoods Orchestrate Antitumoral Immunity at the Colorectal Cancer Invasive Front

“…This was repeated 1000 times. The feature importance was computed as the z-score of the absolute value of the coefficient across resampling, as reported in ( Laurin et al., 2016 ).…”

Development and validation of a lifestyle-based model for colorectal cancer risk prediction: the LiFeCRC score

“…Predictor variable selection was performed using bootstrapped elastic net regularization [ 32 ]. Elastic net regularization is a penalized regression method, combining least absolute shrinkage and selection operator (LASSO) and ridge regression.…”

Identifying the relative importance of non-suicidal self-injury features in classifying suicidal ideation, plans, and behavior using exploratory data mining

“…This is an extension of the relaxed lasso (Meinshausen, 2007). Although the elastic net does not estimate p -values to test the significance of each predictor, using cross-validation to find regression coefficients with non-zero parameter estimates can be thought of as a form of identifying which predictors are “important” (e.g., Laurin et al, 2016). Using repeated cross-validation to choose a final model attempts to derive results with an eye on generalizing to alternate samples.…”