Evaluating patterns in technical and nontechnical skills feedback for surgical residents: insights from SIMPL app data
摘要
Safety in the operating room (OR) requires both technical skills (TS) and non-technical skills (NTS). The feedback that residents receive on NTS remains underexplored. We sought to determine how frequently TS and NTS feedback is documented in SIMPL. We hypothesized that TS feedback would be most frequent, and that the distribution of feedback types (technical-only, NTS-only, both, or neither) would vary by supervision type, resident performance, and attending academic rank.
MethodsWe performed a single-center retrospective analysis of 566 SIMPL evaluations completed by attending surgeons from December 2022 through April 2024. Two independent reviewers categorized each dictated comment using the NOTSS framework as technical-only, non-technical-only, both, or neither; disagreements were resolved by consensus.
ResultsFeedback predominantly addressed technical skills (81.0%), with only 16.8% of comments addressing any NTS domain. Significant variations existed in feedback content based on attending academic rank, type of supervision, resident performance, and resident gender. Feedback distributions differed significantly by academic rank (p < 0.001). Assistant professors provided the highest proportion of mixed feedback (24.8%), compared with associate professors (16.5%) and full professors (5.6%). Full professors more often provided comments classified as neither (24.4%) and technical-only (65.0%), with relatively few mixed comments (5.6%). Feedback also differed by supervision context (p < 0.001), resident performance (p = 0.002), and resident gender (p = 0.012). Women residents were more likely than men to receive comments containing NTS elements (16.5% vs. 9.2%).
ConclusionWhile SIMPL can capture NTS-related observations, such content was infrequently documented and varied by faculty rank, supervision level, resident performance, and resident gender.