Scholarlink

<p>This paper presents a novel <i>Mixture of Experts</i> (MoE)-based framework designed to enhance clinical decision-making by balancing predictive accuracy, interpretability, and adaptability. Our approach relies on a set of locally specialized logistic regression models, dynamically selecting the most suitable expert for each instance based on local feature patterns. To enforce sparsity in both the gating mechanism and expert models, we employ the <i>Gumbel-softmax</i> relaxation, enabling end-to-end differentiable selection of both the active expert and the most relevant features for each prediction. By integrating this mechanism, our method improves computational efficiency and generalization while maintaining instance-level interpretability. Unlike black-box models that require post hoc explanation techniques, our solution provides transparency by construction, offering direct insights into feature contributions for each decision. We evaluated our approach on multiple real-world healthcare datasets, spanning both standard clinical classification tasks and process-oriented predictive scenarios. Experimental results demonstrated that our MoE-based framework achieves robust and competitive performance while maintaining lower complexity than black-box methods such as <i>XGBoost</i> and <i>Random Forest</i> and improving generalization over simpler interpretable models, including <i>Decision Trees</i>, <i>Linear Trees</i>, and standard <i>Logistic Regressors</i>. Additionally, our analysis of the trade-off between model complexity and predictive performance shows that our method delivers stable and reliable results across diverse datasets and evaluation metrics. These findings underscore the advantages of an interpretable MoE-based approach in clinical AI, supporting transparent and accountable decision-making.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Toward trustworthy and sustainable clinical decision support by training ensembles of specialized logistic regressors

  • 期刊论文

  • 发表日期：

    2025年6月13日

查看全文
  • Alfredo Cuzzocrea,
  • Francesco Folino,
  • Luigi Pontieri,
  • Pietro Sabatino,
  • Maryam Samami

摘要

This paper presents a novel Mixture of Experts (MoE)-based framework designed to enhance clinical decision-making by balancing predictive accuracy, interpretability, and adaptability. Our approach relies on a set of locally specialized logistic regression models, dynamically selecting the most suitable expert for each instance based on local feature patterns. To enforce sparsity in both the gating mechanism and expert models, we employ the Gumbel-softmax relaxation, enabling end-to-end differentiable selection of both the active expert and the most relevant features for each prediction. By integrating this mechanism, our method improves computational efficiency and generalization while maintaining instance-level interpretability. Unlike black-box models that require post hoc explanation techniques, our solution provides transparency by construction, offering direct insights into feature contributions for each decision. We evaluated our approach on multiple real-world healthcare datasets, spanning both standard clinical classification tasks and process-oriented predictive scenarios. Experimental results demonstrated that our MoE-based framework achieves robust and competitive performance while maintaining lower complexity than black-box methods such as XGBoost and Random Forest and improving generalization over simpler interpretable models, including Decision Trees, Linear Trees, and standard Logistic Regressors. Additionally, our analysis of the trade-off between model complexity and predictive performance shows that our method delivers stable and reliable results across diverse datasets and evaluation metrics. These findings underscore the advantages of an interpretable MoE-based approach in clinical AI, supporting transparent and accountable decision-making.