Explainable-AI-assisted feature selection for software change-proneness prediction
摘要
Identifying change-prone areas in software is vital for effective maintenance, as it reduces effort and costs while ensuring high-quality software. Achieving real-time predictions of software change-proneness requires training machine learning (ML) models. However, training ML models on high-dimensional open-source datasets is computationally intensive. Therefore, selecting an optimal set of representative features prior to training is essential to reduce computational demands and improve model performance. To this end, existing studies have applied various feature reduction methods; however, the resulting reduced feature sets can sometimes be less suitable or challenging for software practitioners to interpret effectively. To address this, we propose an end-to-end framework utilizing an explainable AI (XAI) method– SHapley Additive explanations (SHAP)– to identify a minimal, meaningful set of predictors. We tested this approach on six open-source software datasets and statistically compared its feature selection capabilities against three traditional methods using six ML algorithms. Our results indicate that machine learning models built using features selected by SHAP achieved higher AUC scores and demonstrated more consistent performance across most of the evaluated datasets. The average AUC obtained through 10-fold cross-validation using SHAP-selected features was