<p>In high-dimensional data analysis, particularly when handling highly correlated covariates, the challenge of simultaneous variable selection and classification remains prevalent in machine learning. To tackle this issue, we propose multi-step adaptive Elastic Net (MSA-Enet) for logistic regression models, which integrates a multi-step estimation framework with an adaptive penalty structure. MSA-Enet enhances the selection of relevant variables through a strategy of applying small repeated penalties and improves classification prediction accuracy. Theoretically, the proposed method is shown to select the true model with high probability and achieve an <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(L_2\)</EquationSource> </InlineEquation>-norm error bound under some regularity conditions. Finally, through simulation studies and the analysis of two gene expression datasets, MSA-Enet reduces model complexity without compromising the accuracy of classification predictions.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-step adaptive elastic net for variable selection and classification in high-dimensional sparse logistic regression models

  • Yiping Yang,
  • Yinghui Huang,
  • Junhua Zhang,
  • Gaorong Li

摘要

In high-dimensional data analysis, particularly when handling highly correlated covariates, the challenge of simultaneous variable selection and classification remains prevalent in machine learning. To tackle this issue, we propose multi-step adaptive Elastic Net (MSA-Enet) for logistic regression models, which integrates a multi-step estimation framework with an adaptive penalty structure. MSA-Enet enhances the selection of relevant variables through a strategy of applying small repeated penalties and improves classification prediction accuracy. Theoretically, the proposed method is shown to select the true model with high probability and achieve an \(L_2\) -norm error bound under some regularity conditions. Finally, through simulation studies and the analysis of two gene expression datasets, MSA-Enet reduces model complexity without compromising the accuracy of classification predictions.