Facial trauma education in radiology: using surgeon feedback as the benchmark for success

Interpreting CT studies of facial trauma is challenging, and there are often substantial differences in the characterization of complex facial trauma between radiologists and surgeons. We designed a collaborative multidisciplinary project to reconcile differences in facial fracture interpretation through an educational intervention. The effectiveness of this intervention was evaluated through surgeon feedback on radiology reports.

Radiology residents, neuroradiology fellows, and neuroradiology attendings were recruited as participants at a single tertiary care academic center. Otolaryngology residents were recruited as evaluators. Participants completed surveys and provided preliminary reports for example cases of facial trauma before and after attending an educational session. Evaluators performed a blinded review of these preliminary reports based on ideal reports developed by surgical and neuroradiology attendings.

26 participants (20 residents, 1 neuroradiology fellow, 5 neuroradiology attendings) completed the study. Six otolaryngology residents participated as evaluators. To assess interrater reliability, three evaluators graded a shared set of 15 reports and demonstrated substantial agreement with a Kendall’s W of 0.71. Participants demonstrated significant improvement in overall report accuracy, clarity, and organization. In subunit analysis, there were significant improvements in reporting Le Fort, nasoseptal, and nasoorbitoethmoid fractures. No significant improvements occurred in the reporting of upper face, zygomaticomaxillary complex, or mandibular fractures. In contrast, survey analysis demonstrated significantly improved confidence in interpreting trauma involving all facial subunits.

Compared with survey results, surgeon assessment of radiology reports better demonstrated areas of improvement after an educational intervention. A multidisciplinary approach to assessing educational efforts may better evaluate the practical effectiveness of educational interventions.