EmoVec: emotion detection in Malayalam using custom word embeddings
摘要
Emotion detection (ED) in natural language processing (NLP) is a critical task with applications in sentiment analysis, chatbots, and user feedback analysis. This study explored the impact of custom-trained embeddings on ED, specifically in Malayalam text. We developed and evaluated novel embedding models, malayalam_word2vec.model and fasttext_model.bin, trained specifically on a Malayalam ED dataset named MalEmo, created from Malayalam novels. We utilized IndicNLP for tokenization and optimized the embeddings to suit the linguistic characteristics of Malayalam. In this work, EmoVec, we developed custom embeddings for ED in Malayalam and compared their performance to pretrained FastText embeddings (cc.ml.300.bin). Additionally, we fine-tuned transformer models (mBERT and MuRIL) for ED tasks and demonstrated that the transformer-based models outperform the state-of-the-art results. Moreover, this work highlighted the importance of IndicNLP tokenization in the training of the proposed embedding models for ED in Malayalam.