Objectives <p>Depth of stromal invasion (DSI) is a key prognostic factor significantly influencing treatment decisions in early-stage cervical cancer (ESCC). This study aims to develop an explainable multimodal data fusion model integrating MRI, radiology reports, and clinical variables for the preoperative assessment of DSI risk.</p> Materials and methods <p>Radiomic features were extracted from preoperative sagittal T2-weighted imaging (T2WI). Bidirectional Encoder Representations from Transformers (BERT) features were derived from the corresponding radiology reports using natural language processing (NLP). Key BERT and radiomic features were selected using the least absolute shrinkage and selection operator (LASSO). Independent clinical risk factors were identified through univariate analysis, followed by multivariate logistic regression. Five machine learning algorithms were employed to construct the clinical (C), text (T), radiomic (R), and multimodal fusion models (T + R, T + R + C). The Shapley Additive exPlanation (SHAP) method interpreted the optimal fusion model.</p> Results <p>Overall, 498 radiomic features (from T2WI) and 384 BERT-derived features (from reports) were extracted per patient. LASSO selected eleven BERT features and nine radiomic features; multivariate analysis identified two independent clinical risk factors. The text-radiomic-clinical fusion model (T + R + C) outperformed all other models, achieving AUCs of 0.912, 0.874, and 0.890 in the training, internal validation, and external validation cohorts, respectively. SHAP analysis revealed that eight BERT features, five radiomic features, and two clinical features ranked among the top 15 most influential predictors.</p> Conclusion <p>The explainable multimodal model improves preoperative DSI risk evaluation in ESCC. However, given the small external cohort (<i>n</i> = 20), these results are preliminary and require further independent multi-center validation before clinical application.</p> Critical relevance <p>The developed model significantly improves preoperative DSI prediction in ESCC through noninvasive imaging analysis, thereby refining risk assessment and guiding precision oncology interventions.</p> Key Points <p><UnorderedList Mark="Bullet"> <ItemContent> <p>DSI is a key prognostic factor significantly influencing treatment decisions in ESCC.</p> </ItemContent> <ItemContent> <p>The explainable multimodal fusion model was established.</p> </ItemContent> <ItemContent> <p>The accuracy of preoperative DSI risk evaluation was beneficial for clinical decision-making.</p> </ItemContent> </UnorderedList></p> Graphical Abstract <p></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MRI- and report-based multimodal model with SHAP-based explanation for preoperative prediction of deep stromal invasion in early-stage cervical cancer

  • Raoying Xie,
  • Yao Ai,
  • Anqi Bao,
  • Lihua Xie,
  • Wenjing Wang,
  • Kangwei Zhu,
  • Jianping Wu,
  • Yiyang Wu,
  • Ruyan Xiong,
  • Xiance Jin

摘要

Objectives

Depth of stromal invasion (DSI) is a key prognostic factor significantly influencing treatment decisions in early-stage cervical cancer (ESCC). This study aims to develop an explainable multimodal data fusion model integrating MRI, radiology reports, and clinical variables for the preoperative assessment of DSI risk.

Materials and methods

Radiomic features were extracted from preoperative sagittal T2-weighted imaging (T2WI). Bidirectional Encoder Representations from Transformers (BERT) features were derived from the corresponding radiology reports using natural language processing (NLP). Key BERT and radiomic features were selected using the least absolute shrinkage and selection operator (LASSO). Independent clinical risk factors were identified through univariate analysis, followed by multivariate logistic regression. Five machine learning algorithms were employed to construct the clinical (C), text (T), radiomic (R), and multimodal fusion models (T + R, T + R + C). The Shapley Additive exPlanation (SHAP) method interpreted the optimal fusion model.

Results

Overall, 498 radiomic features (from T2WI) and 384 BERT-derived features (from reports) were extracted per patient. LASSO selected eleven BERT features and nine radiomic features; multivariate analysis identified two independent clinical risk factors. The text-radiomic-clinical fusion model (T + R + C) outperformed all other models, achieving AUCs of 0.912, 0.874, and 0.890 in the training, internal validation, and external validation cohorts, respectively. SHAP analysis revealed that eight BERT features, five radiomic features, and two clinical features ranked among the top 15 most influential predictors.

Conclusion

The explainable multimodal model improves preoperative DSI risk evaluation in ESCC. However, given the small external cohort (n = 20), these results are preliminary and require further independent multi-center validation before clinical application.

Critical relevance

The developed model significantly improves preoperative DSI prediction in ESCC through noninvasive imaging analysis, thereby refining risk assessment and guiding precision oncology interventions.

Key Points

DSI is a key prognostic factor significantly influencing treatment decisions in ESCC.

The explainable multimodal fusion model was established.

The accuracy of preoperative DSI risk evaluation was beneficial for clinical decision-making.

Graphical Abstract