Post-market adverse drug effects (ADEs) are often found in the clinical notes of Electronic Health Records. We evaluate open-weight large language model, Llama-3.1, for detection of ADEs, Named Entity Recognition, and Entity Linkage tasks across varying prompting techniques suited for text decomposition including, but not limited to zero-shot, few-shot and tree of thought. Finally, we propose a novel improvement to the tree of thought prompting technique which combines consistency and thought merging. Our proposed approach is then evaluated and compared with the other approaches on these tasks using standard metrics for each task (f1, precision and recall).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Evaluating Llama-3.1 for Adverse Drug Event Entity and Relationship Extraction Across Prompting Techniques

  • Howard Prioleau,
  • Saurav K. Aryal,
  • Legand Burge

摘要

Post-market adverse drug effects (ADEs) are often found in the clinical notes of Electronic Health Records. We evaluate open-weight large language model, Llama-3.1, for detection of ADEs, Named Entity Recognition, and Entity Linkage tasks across varying prompting techniques suited for text decomposition including, but not limited to zero-shot, few-shot and tree of thought. Finally, we propose a novel improvement to the tree of thought prompting technique which combines consistency and thought merging. Our proposed approach is then evaluated and compared with the other approaches on these tasks using standard metrics for each task (f1, precision and recall).