A machine-learning-based osteoporosis screening tool integrating the Shapley Additive exPlanation (SHAP) method: model development and validation study
摘要
Rationale: Existing osteoporosis screening tools are inaccurate and inconvenient, prompting the need for a better alternative.
Main result: A machine learning tool (Gradient Boosting) with key factors (weight, age, height) outperformed OST (AUC 0.828 vs 0.781, p < 0.0001) in validation.
SignificanceThe validated, clinically applicable tool improves osteoporosis screening accessibility and accuracy.
BackgroundAs the first “line of defence” for osteoporosis detection, existing screening tools have low accuracy and are inconvenient to use. Therefore, this study aims to develop a machine-learning-based, clinically applicable, and interpretable osteoporosis screening tool.
MethodsThis study included 9405 American participants aged 50 years and older (with the average age of the osteoporosis population in the training set and test set being 72 ± 9 years and 73 ± 8 years, respectively). The study selected 13 clinically accessible indicators as candidate predictive variables, divided the data into a training set and a test set at a ratio of 7:3, used the Lasso for feature selection, compared six statistical and machine learning models, evaluated model performance through metrics such as the Area Under the Receiver Operating Characteristic Curve (AUC), Sensitivity, specificity, F1-score, decision curve, calibration curve, and clinical impact curve, employed the SHAP (Shapley Additive exPlanations) method to enhance model interpretability, and conducted external validation based on an independent dataset from the Second Hospital of Lanzhou University.
Results“Weight,” “age,” and “height” are the most critical predictive factors. Gradient Boosting Machine (GB) showed optimal results, with training and test set AUC (0.850, 0.841), sensitivity (0.757, 0.737), specificity (0.793, 0.779), and F1-score (0.336, 0.316), respectively. External validation (3500 subjects) showed that the GB-based screening tool had an AUC of 0.828, which was significantly higher than that of the traditional Osteoporosis Self-Assessment Tool (OST, AUC = 0.781) via the DeLong test (z = 10.880, p < 0.0001).
ConclusionA clinically applicable osteoporosis screening tool based on machine learning algorithms was developed and validated.