Developing an artificial intelligence tool for detecting fractures of child abuse: preliminary findings
摘要
Approximately 6.9% of children in the United Kingdom have suffered physical abuse. Fractures are a common sign and must not be overlooked due to high recurrence and mortality rates. We aimed to train and assess the diagnostic accuracy of a deep learning-based artificial intelligence model (BoneView) in detecting inflicted fractures.
Materials and methodsThis pragmatic retrospective diagnostic accuracy pilot study focuses on children under 5 years old who underwent skeletal survey examinations for suspected physical abuse at a single tertiary centre between 1st January 2000 and 31st December 2023. Radiographs were extracted from the Picture Archiving and Communication System and divided to retrain and test the model. Radiology reports and retrospective review by one observer were used as the reference standard.
ResultsOur total dataset included 1740 patients (mean age, 8.77 months ± 8.343 [standard deviation], 1026 males). The model’s baseline performance recorded an area under the receiver operating curve (AUC) of 0.46 (95% CI: 0.38, 0.57), with a sensitivity of 44% (95% CI: 35%, 58%) and a specificity of 61% (95% CI: 52%, 71%). For preliminary model training, 329 of 1227 positive studies were annotated, yielding a revised AUC of 0.55 (95% CI: 0.48, 0.66), sensitivity of 52% (95% CI: 43%, 64%), and specificity of 67% (95% CI: 58%, 78%).
ConclusionPreliminary training of a novel AI tool for detecting inflicted fractures yielded improved results from baseline performance. This justifies the completion of annotation and further training of this AI tool to potentially achieve clinically acceptable performance.
Key Points