Sentiment Analysis Based on Pretrained Language Models: Recent Progress

Pre-trained Language Models (PLMs) can be applied to downstream tasks with only fine-tuning, eliminating the need to train the model from scratch. In particular, PLMs have been utilised for Sentiment Analysis (SA), a process that detects, analyses, and extracts the polarity of text sentiments. To help researchers comprehensively understand the existing research on PLM-based SA, identify gaps, establish context, acknowledge previous work, and learn from methodologies, we present a literature review on the topic in this paper. Specifically, we brief the motivation of each method, offer a concise overview of these methods, compare their pros, cons, and performance, and identify the challenges for future research.