From black box to glass box: explainable artificial intelligence for acute kidney injury prediction—a scoping review and the GLASS–AKI translational framework proposal
摘要
Artificial intelligence models for acute kidney injury (AKI) prediction achieve strong discriminative accuracy, yet clinical adoption remains constrained by model opacity and alarm fatigue. Explainable artificial intelligence (XAI) methods may enhance clinician trust and alert acceptance; however, the extent of their clinical validation and implementation remains unclear.
MethodsWe performed a scoping review following PRISMA–ScR guidelines. PubMed, Embase, Web of Science, CINAHL, IEEE Xplore, and ACM Digital Library were searched from January 2012 through February 2026. Studies applying XAI methods to AKI prediction or management in adult inpatients were eligible. Prediction model studies were appraised using PROBAST. We additionally propose the GLASS–AKI conceptual framework as a structured research agenda derived from identified gaps.
ResultsThirty-four studies met inclusion criteria (total patient population > 2.1 million). SHAP-based attribution was the most frequently reported XAI technique (26/34; 76.5%), followed by LIME (9; 26.5%), attention-weight visualization (7; 20.6%), and rule-based surrogates (5; 14.7%). Reported AUROC values ranged from 0.71 to 0.95 (median 0.84). Critically, XAI was applied as a post hoc explanation method in 88.2% of studies and did not inherently alter model discriminative performance. Prospective clinical deployment data were limited to 4 studies (11.8%). PROBAST assessment identified high overall risk of bias in 79.4% of studies, predominantly in the Analysis domain. No study integrated multi-omic biomarker signals with real-time XAI reasoning at the point of care.
ConclusionsXAI methods are increasingly applied to AKI prediction models, but prospective evidence linking explainability to improved clinician behavior or patient outcomes remains limited. We propose the GLASS–AKI framework as a conceptual research agenda—not a validated system—to guide future multicenter prospective evaluation of integrated XAI-biomarker approaches.