Objective <p>This feasibility study aimed to assess the potential of freely available large language models (LLMs) to support clinical decision-making in obstetrics.</p> Methods <p>Five fictional obstetric patient cases, encompassing a range of clinical presentations (preeclampsia, fetal growth restriction, preterm premature rupture of membranes, vaginal bleeding, and abdominal trauma), were presented to three LLMs: Chat-GPT (OpenAI), Gemini (Google), and DeepSeek. The LLMs were tasked with evaluating the patient information, suggesting potential diagnoses, and outlining appropriate management strategies. The responses were qualitatively assessed, and subsequently, four expert obstetricians evaluated the LLMs’ recommendations using the Global Quality Score (GQS).</p> Results <p>The LLMs demonstrated an ability to process complex obstetric scenarios and generate diagnostic and management considerations that often aligned with established clinical principles. In cases like preeclampsia and preterm premature rupture of membranes, the LLMs accurately identified key issues and proposed relevant management steps. For fetal growth restriction, vaginal bleeding, and abdominal trauma, they outlined appropriate evaluation frameworks and differential diagnoses. The responses varied in their level of detail and directness. DeepSeek received the highest GQS for all five cases in total, whereas Google Gemini was outperformed by the two other LLMs in the cases of vaginal bleeding and abdominal trauma.</p> Conclusion <p>This preliminary feasibility assessment suggests that freely available LLMs can generate plausible-sounding responses to obstetric vignettes. Further rigorous evaluation using quantitative methods, real-world data, and exploration of integration strategies is warranted to fully understand their role in enhancing clinical decision-making and improving patient care in obstetric practice.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The role of large language models in the diagnosis and management of obstetric patients: a pilot feasibility study using simulated obstetric cases

  • Iason Psilopatis,
  • Katharina Redling,
  • Valeria Filippi,
  • Sofia Kappos,
  • Julius Emons,
  • Beatrice Mosimann,
  • Tibor A. Zwimpfer

摘要

Objective

This feasibility study aimed to assess the potential of freely available large language models (LLMs) to support clinical decision-making in obstetrics.

Methods

Five fictional obstetric patient cases, encompassing a range of clinical presentations (preeclampsia, fetal growth restriction, preterm premature rupture of membranes, vaginal bleeding, and abdominal trauma), were presented to three LLMs: Chat-GPT (OpenAI), Gemini (Google), and DeepSeek. The LLMs were tasked with evaluating the patient information, suggesting potential diagnoses, and outlining appropriate management strategies. The responses were qualitatively assessed, and subsequently, four expert obstetricians evaluated the LLMs’ recommendations using the Global Quality Score (GQS).

Results

The LLMs demonstrated an ability to process complex obstetric scenarios and generate diagnostic and management considerations that often aligned with established clinical principles. In cases like preeclampsia and preterm premature rupture of membranes, the LLMs accurately identified key issues and proposed relevant management steps. For fetal growth restriction, vaginal bleeding, and abdominal trauma, they outlined appropriate evaluation frameworks and differential diagnoses. The responses varied in their level of detail and directness. DeepSeek received the highest GQS for all five cases in total, whereas Google Gemini was outperformed by the two other LLMs in the cases of vaginal bleeding and abdominal trauma.

Conclusion

This preliminary feasibility assessment suggests that freely available LLMs can generate plausible-sounding responses to obstetric vignettes. Further rigorous evaluation using quantitative methods, real-world data, and exploration of integration strategies is warranted to fully understand their role in enhancing clinical decision-making and improving patient care in obstetric practice.