Multi-step adaptive elastic net for variable selection and classification in high-dimensional sparse logistic regression models
摘要
In high-dimensional data analysis, particularly when handling highly correlated covariates, the challenge of simultaneous variable selection and classification remains prevalent in machine learning. To tackle this issue, we propose multi-step adaptive Elastic Net (MSA-Enet) for logistic regression models, which integrates a multi-step estimation framework with an adaptive penalty structure. MSA-Enet enhances the selection of relevant variables through a strategy of applying small repeated penalties and improves classification prediction accuracy. Theoretically, the proposed method is shown to select the true model with high probability and achieve an