The contradiction between the medical services provided by China’s healthcare industry and the increasingly growing demand for medical care is becoming more prominent. “AI + healthcare” intelligent diagnosis is an effective way to alleviate this contradiction. Large Language Models (LLMs), with their exceptional natural language understanding and reasoning generation capabilities, have opened new pathways for deeply understanding complex medical texts. However, directly applying LLMs to the medical field may result in hallucinations due to the lack of domain-specific medical knowledge. Additionally, retraining LLMs to update their parameters is not only time-consuming and labor-intensive but also costly. To address this, we adopted the LoRA fine-tuning technique, using Chain-of-Thought (CoT) to design prompt templates for training and inference on Qwen2.5 and InternLM2.5. To further enhance prediction accuracy, we introduced a voting mechanism, selecting the top three models with the highest prediction scores for model fusion. During the post-processing stage, we leveraged the powerful capabilities of LLMs in understanding, generation, and correction to carefully evaluate the top two predictions selected after voting, ultimately determining the best answer option. Experimental results show that our method achieved an F1 score of 99.05% in the preliminary round, with an F1 score of 92.10% in the semi-final, securing the fourth place in the overall ranking, which fully validates the effectiveness of this approach.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Typical Medical Case Diagnosis with Voting and Answer Discrimination Using Fine-Tuned LLM

  • Xia Liu,
  • Wenhui Fu,
  • Guangyu Zhou,
  • Bohan Yu,
  • Xiaohan Zhao,
  • Yu Song,
  • Kunli Zhang

摘要

The contradiction between the medical services provided by China’s healthcare industry and the increasingly growing demand for medical care is becoming more prominent. “AI + healthcare” intelligent diagnosis is an effective way to alleviate this contradiction. Large Language Models (LLMs), with their exceptional natural language understanding and reasoning generation capabilities, have opened new pathways for deeply understanding complex medical texts. However, directly applying LLMs to the medical field may result in hallucinations due to the lack of domain-specific medical knowledge. Additionally, retraining LLMs to update their parameters is not only time-consuming and labor-intensive but also costly. To address this, we adopted the LoRA fine-tuning technique, using Chain-of-Thought (CoT) to design prompt templates for training and inference on Qwen2.5 and InternLM2.5. To further enhance prediction accuracy, we introduced a voting mechanism, selecting the top three models with the highest prediction scores for model fusion. During the post-processing stage, we leveraged the powerful capabilities of LLMs in understanding, generation, and correction to carefully evaluate the top two predictions selected after voting, ultimately determining the best answer option. Experimental results show that our method achieved an F1 score of 99.05% in the preliminary round, with an F1 score of 92.10% in the semi-final, securing the fourth place in the overall ranking, which fully validates the effectiveness of this approach.