<p>We tested state-of-the-art LLMs under clinical-scale workloads using two designs: a single agent handling all tasks and a multi-agent orchestrator assigning each task to a dedicated worker. Across retrieval, extraction, and dosing tasks, batch sizes ranged from 5–80. Multi-agent accuracy remained high (90.6% at 5 tasks; 65.3% at 80), while single-agent accuracy collapsed (73.1% to 16.6%; <i>p</i> &lt; 0.01). Multi-agent runs used up to 65-fold fewer tokens and limited latency growth. These findings show that lightweight orchestration preserves accuracy and efficiency under mixed-task clinical loads.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Orchestrated multi agents sustain accuracy under clinical-scale workloads compared to a single agent

  • Eyal Klang,
  • Mahmud Omar,
  • Ganesh Raut,
  • Reem Agbareia,
  • Prem Timsina,
  • Robert Freeman,
  • Nicholas Gavin,
  • Lisa Stump,
  • Alexander W. Charney,
  • Benjamin S. Glicksberg,
  • Girish N. Nadkarni

摘要

We tested state-of-the-art LLMs under clinical-scale workloads using two designs: a single agent handling all tasks and a multi-agent orchestrator assigning each task to a dedicated worker. Across retrieval, extraction, and dosing tasks, batch sizes ranged from 5–80. Multi-agent accuracy remained high (90.6% at 5 tasks; 65.3% at 80), while single-agent accuracy collapsed (73.1% to 16.6%; p < 0.01). Multi-agent runs used up to 65-fold fewer tokens and limited latency growth. These findings show that lightweight orchestration preserves accuracy and efficiency under mixed-task clinical loads.