<p>The digitisation of medical data has enabled large-scale analysis. However, clinical datasets, such as those used for diabetes prediction, often have class imbalances, with disease cases significantly underrepresented. This imbalance poses a significant challenge for traditional machine learning models, which tend to favour the majority classes. Additionally, many high-performance models operate as black boxes, which limits their adoption in clinical practice due to their lack of interpretability. This paper introduces HybGANN, a hybrid framework that integrates Conditional Tabular Generative Adversarial Network (CTGAN) for synthetic minority data generation, a unique hybrid genetic algorithm (GA) that co-evolves hyperparameters and internal weights from artificial neural networks (ANNs) in a Lamarckian fashion, and SHapley Additive Explanations (SHAP) for post-hoc model interpretability. HybGANN provides a semi-automated workflow that improves predictive performance while ensuring transparency and adaptability. Applied to a large-scale diabetes dataset, experiments have demonstrated that the HybGANN model outperforms a benchmark ANN network that also uses the same CTGAN pre-balanced dataset on all key classification metrics. The framework achieves ROC-AUC and PR-AUC values of 0.9184 and 0.9268, respectively, demonstrating its effectiveness and potential as a reliable AI solution for clinical decision support in imbalanced medical fields.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

HybGANN as an interpretable generative evolutionary model for predicting diabetes from imbalanced data

  • Nora Pireci Sejdiu,
  • Blagoj Ristevski,
  • Kostandina Veljanovska,
  • Nikola Rendevski,
  • Azir Aliu

摘要

The digitisation of medical data has enabled large-scale analysis. However, clinical datasets, such as those used for diabetes prediction, often have class imbalances, with disease cases significantly underrepresented. This imbalance poses a significant challenge for traditional machine learning models, which tend to favour the majority classes. Additionally, many high-performance models operate as black boxes, which limits their adoption in clinical practice due to their lack of interpretability. This paper introduces HybGANN, a hybrid framework that integrates Conditional Tabular Generative Adversarial Network (CTGAN) for synthetic minority data generation, a unique hybrid genetic algorithm (GA) that co-evolves hyperparameters and internal weights from artificial neural networks (ANNs) in a Lamarckian fashion, and SHapley Additive Explanations (SHAP) for post-hoc model interpretability. HybGANN provides a semi-automated workflow that improves predictive performance while ensuring transparency and adaptability. Applied to a large-scale diabetes dataset, experiments have demonstrated that the HybGANN model outperforms a benchmark ANN network that also uses the same CTGAN pre-balanced dataset on all key classification metrics. The framework achieves ROC-AUC and PR-AUC values of 0.9184 and 0.9268, respectively, demonstrating its effectiveness and potential as a reliable AI solution for clinical decision support in imbalanced medical fields.