<p>Sentiment analysis is a fundamental task in natural language processing with broad applications. While pre-trained language models have achieved remarkable success in sentiment analysis, these approaches typically require large training data. In sentiment analysis, labeled data may be scarce as the problem expands to new areas, such as novel modes of expression on social media, emerging topics, and reviews on new products. Moreover, given the dynamic nature of real-world applications, continuously updating the data with new information is impractical. This highlights the need for efficient models that perform well with limited labeled data. In this paper, we propose Sentiment Lexicon Integrated Meta-training (SLIM), a novel framework designed to optimize pre-trained language models for sentiment analysis in data-scarce settings. SLIM integrates the knowledge of a sentiment lexicon into self-supervised meta-training tasks. Specifically, we propose three methods, SLIM<sub>boolean</sub>, SLIM<sub>mixed</sub>, and SLIM<sub>polar</sub>, to generate sentiment-aware meta-training tasks by exploiting the semantic relationship between words. SLIM<sub>boolean</sub> distinguishes sentiment-bearing expressions from neutral ones, SLIM<sub>mixed</sub> captures variations among sentiment expressions, and SLIM<sub>polar</sub> explicitly contrasts opposing sentiment polarities. We then meta-train several SLIM models using these task generation methods along with two model initialization settings. Experimental results on 11 benchmark datasets show that SLIM significantly improves performance in few-shot settings, demonstrating the capability of SLIM models to adapt effectively with minimal training examples. When combined with pre-existing sentiment knowledge, our model outperforms recent meta-learning models and sentiment knowledge-enhanced pre-trained language models. Furthermore, we conduct comprehensive ablation studies to examine the impact of specific design choices within the SLIM framework.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Sentiment lexicon integrated meta-training for sentiment analysis in data-scarce settings

  • Hyunjong Kim,
  • Sungzoon Cho

摘要

Sentiment analysis is a fundamental task in natural language processing with broad applications. While pre-trained language models have achieved remarkable success in sentiment analysis, these approaches typically require large training data. In sentiment analysis, labeled data may be scarce as the problem expands to new areas, such as novel modes of expression on social media, emerging topics, and reviews on new products. Moreover, given the dynamic nature of real-world applications, continuously updating the data with new information is impractical. This highlights the need for efficient models that perform well with limited labeled data. In this paper, we propose Sentiment Lexicon Integrated Meta-training (SLIM), a novel framework designed to optimize pre-trained language models for sentiment analysis in data-scarce settings. SLIM integrates the knowledge of a sentiment lexicon into self-supervised meta-training tasks. Specifically, we propose three methods, SLIMboolean, SLIMmixed, and SLIMpolar, to generate sentiment-aware meta-training tasks by exploiting the semantic relationship between words. SLIMboolean distinguishes sentiment-bearing expressions from neutral ones, SLIMmixed captures variations among sentiment expressions, and SLIMpolar explicitly contrasts opposing sentiment polarities. We then meta-train several SLIM models using these task generation methods along with two model initialization settings. Experimental results on 11 benchmark datasets show that SLIM significantly improves performance in few-shot settings, demonstrating the capability of SLIM models to adapt effectively with minimal training examples. When combined with pre-existing sentiment knowledge, our model outperforms recent meta-learning models and sentiment knowledge-enhanced pre-trained language models. Furthermore, we conduct comprehensive ablation studies to examine the impact of specific design choices within the SLIM framework.