Currently, the majority of approaches to syndrome differentiation in Traditional Chinese Medicine (TCM) conceptualize this endeavor as a text classification challenge. The state-of-the-art technique in text classification is the few-shot fine-tuning approach grounded in large language models. This approach minimizes the need for extensive manual annotation while yielding remarkable classification outcomes with a limited number of labeled samples. In this paper, we propose a few-shot fine-tuning approach that integrates two distinct types of prompts tailored for the syndrome differentiation task. One type of prompt directly inquires about the syndrome type, while the other indirectly seeks to infer the syndrome type. Specifically, our approach initially adopts the prefix-tuning approach, which utilizes two prefix vectors to combine these two types of prompts. Subsequently, we fine-tune the prefix-related parameters and combine the results from the two prefix fine-tunings to generate the final output. Experimental results demonstrate the superiority of our proposed approach.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Few-Shot Learning for Syndrome Differentiation with Two Prompts

  • Xian Zhou,
  • Sophia Yat Mei Lee,
  • Xinhe Gang,
  • Yichen Yang,
  • Yu Liu,
  • Shengfeng Ju,
  • Shoushan Li

摘要

Currently, the majority of approaches to syndrome differentiation in Traditional Chinese Medicine (TCM) conceptualize this endeavor as a text classification challenge. The state-of-the-art technique in text classification is the few-shot fine-tuning approach grounded in large language models. This approach minimizes the need for extensive manual annotation while yielding remarkable classification outcomes with a limited number of labeled samples. In this paper, we propose a few-shot fine-tuning approach that integrates two distinct types of prompts tailored for the syndrome differentiation task. One type of prompt directly inquires about the syndrome type, while the other indirectly seeks to infer the syndrome type. Specifically, our approach initially adopts the prefix-tuning approach, which utilizes two prefix vectors to combine these two types of prompts. Subsequently, we fine-tune the prefix-related parameters and combine the results from the two prefix fine-tunings to generate the final output. Experimental results demonstrate the superiority of our proposed approach.