Sparse sufficient dimension reduction for directional regression
摘要
Sufficient dimension reduction has emerged as a powerful tool for extracting meaningful information within high dimensional datasets over the past few decades. These methods aim to reduce the complexity of data by focusing on its most informative components and this allows us to avoid ‘curse of dimensionality’. However, many sufficient dimension reduction methods have challenges because their outcome has the form of the linear combinations of the original predictors. This can make the interpretation of the extracted components quite difficult, particularly when working with a large number of variables. To address this issue, we introduce a sparse sufficient dimension reduction method for directional regression. Our approach converts generalized eigendecomposition to regression type optimization problem with LASSO constraint and this promotes interpretability by generating sparse estimates. Moreover, we provide theoretical support for our proposed method, establishing non-asymptotic oracle inequalities and convergence guarantees for the associated optimization algorithm. We demonstrate the efficacy of our approach by comparing it against existing methods such as non-sparse directional regression, sparse sliced inverse regression, and sliced average variance estimation through comprehensive numerical experiments. We further apply our method to two real-world datasets to present its practical value in extracting meaningful insights from complex data structures.