Scholarlink

Aim <p>ChatGPT, a large language model (LLM) developed by OpenAI, is designed to generate human-like responses through the analysis of textual data. This study aimed to assess the accuracy and diagnostic capability of ChatGPT-4 in answering clinical scenario-based questions regarding oral lesions.</p> Methods <p>The study included 133 multiple-choice questions (MCQs), each consisting of five possible answers, randomly selected from <i>the Clinical Guide to Oral Disease</i>. Two oral medicine specialists reviewed the answers in the book to ensure accuracy. A general dentist categorized the questions into three levels of difficulty, and two oral medicine specialists validated these categorizations. At each level of difficulty, 37 questions were randomly selected. Consequently, the final questionnaire, consisting of a total of 111 questions categorized by difficulty level, was prepared. The process of asking questions began using the ‘’new message’’ command, to minimize potential bias (influence of prior answers), the researchers manually cleared the chat history before presenting each new question.</p> Result <p>ChatGPT-4.0 demonstrated an accuracy rate of 97% for easy questions, 86.5% ± 34.6% for medium-level questions, and 78.4% ± 41.7% for difficult questions, with an overall accuracy rate of 87.4% ± 33.3.</p> Conclusion <p>Although ChatGPT-4.0 demonstrated satisfactory accuracy in answering clinical questions, its responses should not be exclusively relied upon for diagnostic purposes. Instead, the model should be utilized as a complementary tool under the supervision of clinicians in the diagnosis of oral lesions.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

ChatGpt’s accuracy in the diagnosis of oral lesions

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年7月21日

查看全文
  • Pedram Hajibagheri,
  • Sahba Khosousi Sani,
  • Mohammad Samami,
  • Rasoul Tabari-Khomeiran,
  • Kiana Azadpeyma,
  • Mohammad Khosousi Sani

摘要

Aim

ChatGPT, a large language model (LLM) developed by OpenAI, is designed to generate human-like responses through the analysis of textual data. This study aimed to assess the accuracy and diagnostic capability of ChatGPT-4 in answering clinical scenario-based questions regarding oral lesions.

Methods

The study included 133 multiple-choice questions (MCQs), each consisting of five possible answers, randomly selected from the Clinical Guide to Oral Disease. Two oral medicine specialists reviewed the answers in the book to ensure accuracy. A general dentist categorized the questions into three levels of difficulty, and two oral medicine specialists validated these categorizations. At each level of difficulty, 37 questions were randomly selected. Consequently, the final questionnaire, consisting of a total of 111 questions categorized by difficulty level, was prepared. The process of asking questions began using the ‘’new message’’ command, to minimize potential bias (influence of prior answers), the researchers manually cleared the chat history before presenting each new question.

Result

ChatGPT-4.0 demonstrated an accuracy rate of 97% for easy questions, 86.5% ± 34.6% for medium-level questions, and 78.4% ± 41.7% for difficult questions, with an overall accuracy rate of 87.4% ± 33.3.

Conclusion

Although ChatGPT-4.0 demonstrated satisfactory accuracy in answering clinical questions, its responses should not be exclusively relied upon for diagnostic purposes. Instead, the model should be utilized as a complementary tool under the supervision of clinicians in the diagnosis of oral lesions.