Text classification, where each input text is assigned to a single category, is a fundamental task in natural language processing. In this paper, we propose a novel framework that combines BERT-based contextual embeddings with a reinforcement learning technique known as group relative policy optimization (GRPO). To enrich input representations, we employ prompt-based text generation using GPT models. It helps create diverse paraphrased variants that are fused with the original embeddings. It is then used to train a classifier using the GRPO, which improves stability and reduces reliance on conventional supervised objectives. We conduct experiments on the baseline BERT model and perform an ablation study of our proposed pipeline using a financial fraud classification dataset. It shows that the integration of generative augmentation and policy-based learning leads to improved classification performance and training efficacy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Text Classification Using LLM and Group Relative Policy Optimization (GRPO)

  • Vikas Vaghasiya,
  • Disha Shimpi,
  • Pratik Shah,
  • Jignesh S. Bhatt

摘要

Text classification, where each input text is assigned to a single category, is a fundamental task in natural language processing. In this paper, we propose a novel framework that combines BERT-based contextual embeddings with a reinforcement learning technique known as group relative policy optimization (GRPO). To enrich input representations, we employ prompt-based text generation using GPT models. It helps create diverse paraphrased variants that are fused with the original embeddings. It is then used to train a classifier using the GRPO, which improves stability and reduces reliance on conventional supervised objectives. We conduct experiments on the baseline BERT model and perform an ablation study of our proposed pipeline using a financial fraud classification dataset. It shows that the integration of generative augmentation and policy-based learning leads to improved classification performance and training efficacy.