Importance <p>Cancer patients are more prone to depression and anxiety symptoms compared to those with chronic diseases. Amidst surging clinical demands and constrained medical resources, the traditional radiology workflows, plagued by inefficient communication, exacerbates both patients’ psychological distress and healthcare providers’ burnout.</p> Objective <p>To develop and validate a fine-tuned DeepSeek R1-based Radiology Examination Chatbot (REC) to optimize clinical interaction between cancer patients and radiology healthcare providers (RHPs), thereby effectively providing emotional support for cancer patients and reducing burnout among RHPs.</p> Design, setting, and participants <p>Audio recordings of multi-scenarios (appointment triage (AT), pre-examination preparation (PP), radiology clinic services (RCS)) were collected from the radiology departments of three tertiary hospitals (<i>n</i> = 36,511&#xa0;min). This study conducts two independent randomized controlled sub-trials for distinct patient groups: Sub-trial 1 evaluates AT/PP participants (1,424 patients, 1:1 randomized to RHP + REC or RHP), while Sub-trial 2 assesses RCS participants (638 patients, 1:1 randomized to the same groups). Due to differing patient populations, the sub-trials were designed and implemented separately.</p> Intervention <p>The REC was fine-tuned using domain-specific dialogue data (80% for training) and scenario-specific prompts, with GPT-o1 as a comparative benchmark. Sub-trials randomized patients to RHP + REC or RHP groups.</p> Main outcome and measures <p>The primary outcome included dialogue quality (empathy, frustration, emotional regulation, factuality, integrity, and satisfaction), while the secondary outcomes comprised burnout (exhaustion, depersonalization, and personal achievement) and image quality (CT/MRI), all assessed via Likert scales and statistical tests.</p> Results <p>RHP + REC group demonstrated superior dialogue quality in AT (factuality: 4.12 ± 0.86 vs. 3.39 ± 1.21, <i>P</i> &lt; 0.001) and PP (satisfaction: 3.73 ± 0.11 vs. 3.19 ± 0.18, <i>P</i> &lt; 0.001), with reduced burnout (exhaustion: 1.85 ± 0.91 vs. 2.40 ± 1.22, <i>P</i> &lt; 0.01). CT image quality improved significantly (4.35 ± 0.51 vs. 4.00 ± 0.52, <i>P</i> &lt; 0.01), and similar results were achieved in MRI examinations (4.12 ± 0.51 vs. 3.79 ± 0.58, <i>P</i> = 0.02). However, REC underperformed in empathy and emotional regulation during emotionally complex RCS (3.88 ± 0.67 vs. 4.42 ± 0.53, <i>P</i> = 0.002; 3.87 ± 0.19 vs. 4.12 ± 0.27, <i>P</i> = 0.004). Ablation studies confirmed the necessity of fine-tuning and scenario-specific prompts for performance.</p> Conclusion and relevance <p>Overall, the DeepSeek R1-based REC synergistically enhanced multi-scenarios clinical interaction, provided emotional support for cancer patients, and reduced RHPs’ burnout, offering a scalable solution to optimize radiology workflows.</p> Trial registration <p>Chinese Clinical Trial Registry Registration number: (ChiCTR2500102740||<a href="http://www.chictr.org.cn/">http://www.chictr.org.cn/</a>), Registration Date: 2025-05-26.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A fine-tuned large language model chatbot for multi-scenario radiology cancer care: randomized controlled trial on interaction optimization, emotional support, and provider burnout reduction

  • Zhi Liu,
  • Farrin Orouji,
  • Fan Yang,
  • Zhuowei Shi,
  • Hongwei Liang,
  • Bing Yu,
  • Jiahui Wu,
  • Zhipeng Wen,
  • Long Tang,
  • Hongyu Pan,
  • Zhiwei Zhang,
  • Yongmei Li,
  • Liqiang Zhang

摘要

Importance

Cancer patients are more prone to depression and anxiety symptoms compared to those with chronic diseases. Amidst surging clinical demands and constrained medical resources, the traditional radiology workflows, plagued by inefficient communication, exacerbates both patients’ psychological distress and healthcare providers’ burnout.

Objective

To develop and validate a fine-tuned DeepSeek R1-based Radiology Examination Chatbot (REC) to optimize clinical interaction between cancer patients and radiology healthcare providers (RHPs), thereby effectively providing emotional support for cancer patients and reducing burnout among RHPs.

Design, setting, and participants

Audio recordings of multi-scenarios (appointment triage (AT), pre-examination preparation (PP), radiology clinic services (RCS)) were collected from the radiology departments of three tertiary hospitals (n = 36,511 min). This study conducts two independent randomized controlled sub-trials for distinct patient groups: Sub-trial 1 evaluates AT/PP participants (1,424 patients, 1:1 randomized to RHP + REC or RHP), while Sub-trial 2 assesses RCS participants (638 patients, 1:1 randomized to the same groups). Due to differing patient populations, the sub-trials were designed and implemented separately.

Intervention

The REC was fine-tuned using domain-specific dialogue data (80% for training) and scenario-specific prompts, with GPT-o1 as a comparative benchmark. Sub-trials randomized patients to RHP + REC or RHP groups.

Main outcome and measures

The primary outcome included dialogue quality (empathy, frustration, emotional regulation, factuality, integrity, and satisfaction), while the secondary outcomes comprised burnout (exhaustion, depersonalization, and personal achievement) and image quality (CT/MRI), all assessed via Likert scales and statistical tests.

Results

RHP + REC group demonstrated superior dialogue quality in AT (factuality: 4.12 ± 0.86 vs. 3.39 ± 1.21, P < 0.001) and PP (satisfaction: 3.73 ± 0.11 vs. 3.19 ± 0.18, P < 0.001), with reduced burnout (exhaustion: 1.85 ± 0.91 vs. 2.40 ± 1.22, P < 0.01). CT image quality improved significantly (4.35 ± 0.51 vs. 4.00 ± 0.52, P < 0.01), and similar results were achieved in MRI examinations (4.12 ± 0.51 vs. 3.79 ± 0.58, P = 0.02). However, REC underperformed in empathy and emotional regulation during emotionally complex RCS (3.88 ± 0.67 vs. 4.42 ± 0.53, P = 0.002; 3.87 ± 0.19 vs. 4.12 ± 0.27, P = 0.004). Ablation studies confirmed the necessity of fine-tuning and scenario-specific prompts for performance.

Conclusion and relevance

Overall, the DeepSeek R1-based REC synergistically enhanced multi-scenarios clinical interaction, provided emotional support for cancer patients, and reduced RHPs’ burnout, offering a scalable solution to optimize radiology workflows.

Trial registration

Chinese Clinical Trial Registry Registration number: (ChiCTR2500102740||http://www.chictr.org.cn/), Registration Date: 2025-05-26.