Scholarlink

<p>This study explored a critical gap in fundamental knowledge of AI/client interactions by asking students to compare the accuracy, thoroughness, and helpfulness of chatbot responses pertaining to the pharmacology of important medications. Eighteen undergraduates enrolled in an introductory pharmacology course at a Midwestern public university used standardized prompts to elicit drug interaction information for five commonly prescribed medications: aspirin, semaglutide, losartan, Yescarta, and a student-selected anesthetic. The chatbots were ChatGPT 3.0, Copilot, and Gemini 1.5. Each student evaluated responses generated by two of three platforms. While all chatbots were rated highly for accuracy, perceptions of helpfulness and thoroughness varied across platforms and prompts. ChatGPT was most consistently rated as thorough and helpful overall, though Gemini outperformed it on select prompts. Comparisons between Copilot and Gemini slightly favored Copilot, but not across all prompts. Taken together, student feedback indicates that the tone and delivery of information may influence perceptions of chatbot helpfulness and completeness. In effect, chatbots’ bedside manner may influence users. Two-thirds of participants indicated they would recommend using AI chatbots to understand medications. These findings underscore the importance of developing patient-centered educational resources that guide effective and ethical use of AI tools in healthcare communication, particularly as AI becomes more consistently integrated into clinical and medical education settings.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Undergraduates perceive differences in helpfulness and thoroughness of responses of ChatGPT 3.0, Gemini 1.5, and copilot responses about drug interactions

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年10月6日

查看全文
  • Jennifer E. Grant

摘要

This study explored a critical gap in fundamental knowledge of AI/client interactions by asking students to compare the accuracy, thoroughness, and helpfulness of chatbot responses pertaining to the pharmacology of important medications. Eighteen undergraduates enrolled in an introductory pharmacology course at a Midwestern public university used standardized prompts to elicit drug interaction information for five commonly prescribed medications: aspirin, semaglutide, losartan, Yescarta, and a student-selected anesthetic. The chatbots were ChatGPT 3.0, Copilot, and Gemini 1.5. Each student evaluated responses generated by two of three platforms. While all chatbots were rated highly for accuracy, perceptions of helpfulness and thoroughness varied across platforms and prompts. ChatGPT was most consistently rated as thorough and helpful overall, though Gemini outperformed it on select prompts. Comparisons between Copilot and Gemini slightly favored Copilot, but not across all prompts. Taken together, student feedback indicates that the tone and delivery of information may influence perceptions of chatbot helpfulness and completeness. In effect, chatbots’ bedside manner may influence users. Two-thirds of participants indicated they would recommend using AI chatbots to understand medications. These findings underscore the importance of developing patient-centered educational resources that guide effective and ethical use of AI tools in healthcare communication, particularly as AI becomes more consistently integrated into clinical and medical education settings.