Family Doctor Model Training Based on Large Language Model Tuning
摘要
As society increasingly focuses on health issues, the importance of the role of family doctors becomes more apparent. The question of how to use cutting-edge technology to improve the accessibility and efficiency of medical services is a critical topic. Generative large language models, with their excellent capabilities in natural language processing, offer new possibilities for the implementation of intelligent family doctor systems. This study focuses on the application of generative large language models in family doctor systems, selecting the ChatGLM2-6B model as the base model for this research. Through a custom-written data collection program, a dataset containing 170,000 high-quality medical question-and-answer entries was constructed. The LoRA method was used to tune the base model, and the performance of the original and tuned models in medical question-and-answer tasks was examined. The practical results of this study show that the generatively tuned large language model has achieved a 70% improvement in ROUGE scores compared to the untuned model, validating the effectiveness of large language model tuning in the family doctor field. Furthermore, this study has open-sourced the collected dataset and program, providing a technical reference for deploying efficient and accurate question-and-answer systems in similar vertical fields in the future.