Multi-label text classification (MLTC) faces significant challenges in real-world scenarios due to complex label correlations and the scarcity of labeled data. Existing MLTC methods typically rely on large amounts of labeled data to learn text representations and label dependencies, severely limiting their few-shot ability. While prompt tuning has recently emerged as an effective few-shot learning strategy, its potential in MLTC remains underexplored due to the inherent gap between masked language modeling and multi-label classification. In this paper, we propose a Dual-Verbalizer framework with Label Correlation modeling (DVLC)(The code is available at: https://anonymous.4open.science/r/DVLC ) for few-shot MLTC, integrating multi-label correlation modeling into the prompt tuning framework. Specifically, we introduce text-specific continuous prefixes that incorporate text features into soft prompts, and develop a GCN-based verbalizer with multi-label modeling, which collaborates with a mask verbalizer for prediction. In addition, we apply supervised contrastive learning based on multi-label similarity to improve generalization and mitigate overfitting. Extensive experiments demonstrate the effectiveness of DVLC in few-shot settings.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Dual-Verbalizer with Label Correlation Modeling for Few-Shot Multi-Label Text Classification

  • Zhiyi Tian,
  • Jingwen Sun,
  • Guangzhong Sun,
  • Jingwei Sun,
  • Yu He

摘要

Multi-label text classification (MLTC) faces significant challenges in real-world scenarios due to complex label correlations and the scarcity of labeled data. Existing MLTC methods typically rely on large amounts of labeled data to learn text representations and label dependencies, severely limiting their few-shot ability. While prompt tuning has recently emerged as an effective few-shot learning strategy, its potential in MLTC remains underexplored due to the inherent gap between masked language modeling and multi-label classification. In this paper, we propose a Dual-Verbalizer framework with Label Correlation modeling (DVLC)(The code is available at: https://anonymous.4open.science/r/DVLC ) for few-shot MLTC, integrating multi-label correlation modeling into the prompt tuning framework. Specifically, we introduce text-specific continuous prefixes that incorporate text features into soft prompts, and develop a GCN-based verbalizer with multi-label modeling, which collaborates with a mask verbalizer for prediction. In addition, we apply supervised contrastive learning based on multi-label similarity to improve generalization and mitigate overfitting. Extensive experiments demonstrate the effectiveness of DVLC in few-shot settings.