Scholarlink

Objective <p>To evaluate the performance fairness of a long short-term memory (LSTM) model in predicting in-hospital mortality for inpatients with varying severity, as reflected by length of stay (LOS) and initial clinical scores.</p> Materials and methods <p>This retrospective study used the Medical Information Mart for Intensive Care (MIMIC)-IV database, which includes records from over 50,000 ICU patients. Patients were divided into subgroups based on LOS and Simplified Acute Physiology Score (SAPS) II. The LSTM model was trained on the training set and then tested on these subgroups in the test set. Metrics such as area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), accuracy, sensitivity, and specificity were used to evaluate model performance. Statistical analyses, including logistic regression and Bonferroni correction, were conducted to compare performance across subgroups.</p> Results <p>The LSTM model’s performance varied significantly among different LOS and SAPS II score groups. The overall AUROC was 0.834, but the model performed better for patients with shorter LOS and lower SAPS II scores. The highest AUROC of 0.931 was observed in the [12, 94) hours LOS group, and 0.811 in the [0, 25) SAPS II score group. The model’s accuracy decreased with increasing LOS and SAPS II scores. Logistic regression confirmed that LOS and SAPS II scores significantly affected model accuracy, with longer LOS and higher SAPS II scores associated with poorer model performance.</p> Discussion and conclusion <p>When using long-term outcomes like in-hospital death to build early assessment models, there are significant fairness issues in model performance across LOS and SAPS II groups. Developing dynamic prediction models using short-term outcomes may help reduce these fairness issues.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Performance fairness of neural network models in early risk assessment of inpatients with varying severity: a retrospective study

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年3月27日

查看全文
  • Lan Lan,
  • Shixin Huang,
  • Yang Chen,
  • Shuya Lu,
  • Jiawei Luo

摘要

Objective

To evaluate the performance fairness of a long short-term memory (LSTM) model in predicting in-hospital mortality for inpatients with varying severity, as reflected by length of stay (LOS) and initial clinical scores.

Materials and methods

This retrospective study used the Medical Information Mart for Intensive Care (MIMIC)-IV database, which includes records from over 50,000 ICU patients. Patients were divided into subgroups based on LOS and Simplified Acute Physiology Score (SAPS) II. The LSTM model was trained on the training set and then tested on these subgroups in the test set. Metrics such as area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), accuracy, sensitivity, and specificity were used to evaluate model performance. Statistical analyses, including logistic regression and Bonferroni correction, were conducted to compare performance across subgroups.

Results

The LSTM model’s performance varied significantly among different LOS and SAPS II score groups. The overall AUROC was 0.834, but the model performed better for patients with shorter LOS and lower SAPS II scores. The highest AUROC of 0.931 was observed in the [12, 94) hours LOS group, and 0.811 in the [0, 25) SAPS II score group. The model’s accuracy decreased with increasing LOS and SAPS II scores. Logistic regression confirmed that LOS and SAPS II scores significantly affected model accuracy, with longer LOS and higher SAPS II scores associated with poorer model performance.

Discussion and conclusion

When using long-term outcomes like in-hospital death to build early assessment models, there are significant fairness issues in model performance across LOS and SAPS II groups. Developing dynamic prediction models using short-term outcomes may help reduce these fairness issues.