Emotion recognition in conversation (ERC) is an interdisciplinary field focused on identifying the emotional state of each utterance in a dialogue. However, existing ERC studies use fixed and single prompt templates, and the resulting utterance embeddings fail to adequately represent the subtle semantic differences between utterances. Additionally, there is an unclear relationship between the way utterances are expressed and their corresponding emotional states, which impacts the model inference and the quality of generation. ERC datasets are typically class-imbalanced, leading to imbalanced gradients when handling different emotion categories. To address these issues, we propose the gradient reweighting-based representation intervention and prompting framework (GRIP-ERC). GRIP-ERC consists of a representation extractor and an unbiased classifier. In the representation extractor, GRIP-ERC adds soft prompts in the hidden layer of the PLMs, which are composed of task-specific and instance-specific elements, allowing for a more complete representation of the semantic differences of utterances. Additionally, GRIP-ERC intervenes in hidden representations within the linear subspace spanned by a low-rank projection matrix to guiding model behavior during reasoning and improving the quality of generation. In the unbiased classifier, GRIP-ERC reweights the imbalanced gradient matrix on a per-class basis and uses a balance vector adaptively adjusted by historical accumulated gradients. Experimental results show that GRIP-ERC outperforms state-of-the-art methods on all three benchmark datasets, validating its effectiveness.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Gradient Reweighting-Based Representation Intervention and Prompting Framework for Emotion Recognition in Conversation

  • Yukun Cao,
  • Lisheng Wang,
  • Luobin Huang,
  • Xuefeng Xu,
  • Zhihao Guo,
  • Yongcheng He

摘要

Emotion recognition in conversation (ERC) is an interdisciplinary field focused on identifying the emotional state of each utterance in a dialogue. However, existing ERC studies use fixed and single prompt templates, and the resulting utterance embeddings fail to adequately represent the subtle semantic differences between utterances. Additionally, there is an unclear relationship between the way utterances are expressed and their corresponding emotional states, which impacts the model inference and the quality of generation. ERC datasets are typically class-imbalanced, leading to imbalanced gradients when handling different emotion categories. To address these issues, we propose the gradient reweighting-based representation intervention and prompting framework (GRIP-ERC). GRIP-ERC consists of a representation extractor and an unbiased classifier. In the representation extractor, GRIP-ERC adds soft prompts in the hidden layer of the PLMs, which are composed of task-specific and instance-specific elements, allowing for a more complete representation of the semantic differences of utterances. Additionally, GRIP-ERC intervenes in hidden representations within the linear subspace spanned by a low-rank projection matrix to guiding model behavior during reasoning and improving the quality of generation. In the unbiased classifier, GRIP-ERC reweights the imbalanced gradient matrix on a per-class basis and uses a balance vector adaptively adjusted by historical accumulated gradients. Experimental results show that GRIP-ERC outperforms state-of-the-art methods on all three benchmark datasets, validating its effectiveness.