Complex and heterogeneous personal health time-series data present significant challenges for existing modeling approaches, especially concerning the accuracy and robustness of reasoning processes. Traditional methods often fail to explicitly capture the inherent logical structures necessary for accurate health predictions, leading to suboptimal performance in complex real-world scenarios. This paper proposes HealthTimeLLM-R1, a novel time-series reasoning enhancement method leveraging reinforcement learning (RL)-enhanced large language models (LLMs). We first construct a high-quality healthcare reasoning dataset containing detailed reasoning pathways by employing automated annotation techniques using advanced LLMs. We then introduce a two-stage optimization strategy combining chain-of-thought (CoT) supervised fine-tuning with Group Relative Policy Optimization (GRPO)-based reinforcement learning, systematically enhancing the model’s reasoning capability in healthcare tasks. Experimental results on multiple health-related time-series tasks show that our method substantially improves reasoning accuracy compared to existing benchmarks, highlighting the potential of RL-enhanced LLMs for robust and reliable healthcare applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Empowering Healthcare Time-Series Reasoning by Reinforcement Learning-Enhanced Large Language Models

  • Jun Liu,
  • Yang Gu

摘要

Complex and heterogeneous personal health time-series data present significant challenges for existing modeling approaches, especially concerning the accuracy and robustness of reasoning processes. Traditional methods often fail to explicitly capture the inherent logical structures necessary for accurate health predictions, leading to suboptimal performance in complex real-world scenarios. This paper proposes HealthTimeLLM-R1, a novel time-series reasoning enhancement method leveraging reinforcement learning (RL)-enhanced large language models (LLMs). We first construct a high-quality healthcare reasoning dataset containing detailed reasoning pathways by employing automated annotation techniques using advanced LLMs. We then introduce a two-stage optimization strategy combining chain-of-thought (CoT) supervised fine-tuning with Group Relative Policy Optimization (GRPO)-based reinforcement learning, systematically enhancing the model’s reasoning capability in healthcare tasks. Experimental results on multiple health-related time-series tasks show that our method substantially improves reasoning accuracy compared to existing benchmarks, highlighting the potential of RL-enhanced LLMs for robust and reliable healthcare applications.