Purpose <p>Many medical AI models perform unevenly across patient groups because they learn shortcuts from biased data. These hidden biases make models less reliable and less fair in real-world use. This work aims to develop a system that remains accurate and fair across different patient subpopulations, even when those groups are not explicitly labeled.</p> Methods <p>We introduce DPE-Former, a model that combines prototype-based learning with transformer attention. The system trains several complementary classifiers on balanced subsets of data, each capturing different aspects of the population. A transformer module then learns how to combine its outputs in an adaptive way, helping the model make more balanced decisions across unseen or minority groups.</p> Results <p>Across diverse datasets, including prostate ultrasound, skin lesion images, and cardiac patient records, DPE-Former achieved higher accuracy on underrepresented groups and more consistent performance overall compared to standard training methods.</p> Conclusion <p>DPE-Former offers a simple yet effective approach to reduce hidden bias in medical AI. By improving fairness and reliability across both image and tabular data, it supports more equitable decision-making in clinical applications such as cancer diagnosis and cardiac care. Code is publicly available at <a href="https://github.com/minhto2802/prototypical-ensemble-med">https://github.com/minhto2802/prototypical-ensemble-med</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Shift happens: a fairness-oriented framework for medical classification under hidden bias

  • Minh Nguyen Nhat To,
  • Diane Kim,
  • Mohamed Harmanani,
  • Paul F. R. Wilson,
  • Fahimeh Fooladgar,
  • Samira Sojoudi,
  • Amoon Jamzad,
  • Sherif Abdalla,
  • Teresa Tsang,
  • Christina Luong,
  • Silvia Chang,
  • Peter Black,
  • Robert Siemens,
  • Michael Leveridge,
  • Rahul G. Krishnan,
  • Parvin Mousavi,
  • Purang Abolmaesumi

摘要

Purpose

Many medical AI models perform unevenly across patient groups because they learn shortcuts from biased data. These hidden biases make models less reliable and less fair in real-world use. This work aims to develop a system that remains accurate and fair across different patient subpopulations, even when those groups are not explicitly labeled.

Methods

We introduce DPE-Former, a model that combines prototype-based learning with transformer attention. The system trains several complementary classifiers on balanced subsets of data, each capturing different aspects of the population. A transformer module then learns how to combine its outputs in an adaptive way, helping the model make more balanced decisions across unseen or minority groups.

Results

Across diverse datasets, including prostate ultrasound, skin lesion images, and cardiac patient records, DPE-Former achieved higher accuracy on underrepresented groups and more consistent performance overall compared to standard training methods.

Conclusion

DPE-Former offers a simple yet effective approach to reduce hidden bias in medical AI. By improving fairness and reliability across both image and tabular data, it supports more equitable decision-making in clinical applications such as cancer diagnosis and cardiac care. Code is publicly available at https://github.com/minhto2802/prototypical-ensemble-med.