This research solves the “black box” problem of AI implementation in imaging by introducing a transparent, statistically grounded approach to breast cancer risk stratification via infrared thermography without compromising performance. Using the public DMR-IR dataset, statistical feature engineering was applied to training data by extracting first- and second-order statistical features. After ensuring non-normality with a Shapiro-Wilk test, feature significance was established with the Mann-Whitney U test. LASSO regularization selected the five most predictive features: mean, standard deviation, kurtosis, correlation, and energy. To counteract class imbalance, SMOTE was applied, and two machine learning models—logistic regression and random forest (classifier)—were trained on the balanced data and then evaluated on an unseen test dataset. Reporting an AUC of 0.98 over logistic regression’s 0.96 reflects stringent statistical feature engineering and great generalization, creating a strong and interpretable model for breast cancer diagnosis in thermal images, and instills more clinical confidence in AI-based diagnostic systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Interpretable Breast Cancer Risk Stratification Using Statistical Feature Engineering on Thermal Images

  • Chandrima Hazra,
  • Mini Jayan,
  • J. S. Saleema

摘要

This research solves the “black box” problem of AI implementation in imaging by introducing a transparent, statistically grounded approach to breast cancer risk stratification via infrared thermography without compromising performance. Using the public DMR-IR dataset, statistical feature engineering was applied to training data by extracting first- and second-order statistical features. After ensuring non-normality with a Shapiro-Wilk test, feature significance was established with the Mann-Whitney U test. LASSO regularization selected the five most predictive features: mean, standard deviation, kurtosis, correlation, and energy. To counteract class imbalance, SMOTE was applied, and two machine learning models—logistic regression and random forest (classifier)—were trained on the balanced data and then evaluated on an unseen test dataset. Reporting an AUC of 0.98 over logistic regression’s 0.96 reflects stringent statistical feature engineering and great generalization, creating a strong and interpretable model for breast cancer diagnosis in thermal images, and instills more clinical confidence in AI-based diagnostic systems.