Scholarlink

<p>This study evaluates the quality of artificial intelligence (AI) clinical note summarization by analyzing physician qualitative feedback on a large language model (LLM) chart review tool integrated into the electronic health record (EHR). Physicians provided free-text feedback on AI-generated chart summaries, which physician informaticists analyzed using MAXQDA. Feedback from 10 physicians was collected on 147 AI-generated summaries. Positive feedback was common (<i>n</i> = 71), but users identified omissions (<i>n</i> = 46), confusing content (<i>n</i> = 20), token limitations (<i>n</i> = 27), hallucinations (<i>n</i> = 5), and bias (<i>n</i> = 1). Cohen’s Kappa was 0.64, indicating substantial reviewer agreement. Physician feedback on the tool revealed overall positive impressions, though omissions raised concerns about summary completeness. AI-assisted chart review technology is not infallible, but physicians found this tool acceptable for use in clinical workflows.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Evaluation of electronic health record-integrated artificial intelligence chart review

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年1月28日

查看全文
  • Nicolas M. Kahl,
  • Marshall J. Frieden,
  • Zach R. Pope,
  • Marlene M. Millen,
  • Vaishal M. Tolia,
  • Theodore C. Chan,
  • Christopher A. Longhurst,
  • Karandeep Singh,
  • Alan X. You

摘要

This study evaluates the quality of artificial intelligence (AI) clinical note summarization by analyzing physician qualitative feedback on a large language model (LLM) chart review tool integrated into the electronic health record (EHR). Physicians provided free-text feedback on AI-generated chart summaries, which physician informaticists analyzed using MAXQDA. Feedback from 10 physicians was collected on 147 AI-generated summaries. Positive feedback was common (n = 71), but users identified omissions (n = 46), confusing content (n = 20), token limitations (n = 27), hallucinations (n = 5), and bias (n = 1). Cohen’s Kappa was 0.64, indicating substantial reviewer agreement. Physician feedback on the tool revealed overall positive impressions, though omissions raised concerns about summary completeness. AI-assisted chart review technology is not infallible, but physicians found this tool acceptable for use in clinical workflows.