<p>A curriculum-aligned generative AI chatbot was developed to create USMLE-style anatomy multiple-choice questions using open-access resources. Subject matter experts evaluated 100 of these questions and 83% were found to be potentially usable, with many needing minimal or no modifications. Sentiment analysis of subject matter expert interviews showed mild positive sentiment while acknowledging both advantages and limitations of AI-generated assessment items. Interestingly, the chatbot revealed discrepancies between faculty expectations and documented learning objectives, highlighting opportunities for curricular improvement. This ethically designed system provides a scalable, cost-effective approach to enhance equity and support local assessment development in medical education.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

GenAI and Faculty Collaboration Support Feasible Development of Curriculum-Aligned Open-Access Board-Style Questions

  • Ronaé McLin,
  • Colleen M. Croniger,
  • Amy L. Wilson-Delfosse

摘要

A curriculum-aligned generative AI chatbot was developed to create USMLE-style anatomy multiple-choice questions using open-access resources. Subject matter experts evaluated 100 of these questions and 83% were found to be potentially usable, with many needing minimal or no modifications. Sentiment analysis of subject matter expert interviews showed mild positive sentiment while acknowledging both advantages and limitations of AI-generated assessment items. Interestingly, the chatbot revealed discrepancies between faculty expectations and documented learning objectives, highlighting opportunities for curricular improvement. This ethically designed system provides a scalable, cost-effective approach to enhance equity and support local assessment development in medical education.