Multilingual Content Moderation: Advanced Hate Speech Detection with XLM-RoBERTa
摘要
The surge in offensive and hate speech across online platforms poses a formidable challenge, particularly for website owners with limited resources for content moderation. Addressing this need, we propose the development of a multilingual model for offensive and hate speech detection using transfer learning, leveraging the capabilities of models like XLM-RoBERTa. This approach aims to provide an accessible and cost-effective solution to enable website administrators to maintain a safer online environment by automatically identifying and moderating inappropriate content. By integrating a robust, pre-trained model, this single model can detect hate speech across three languages like Tamil, Malayalam, and Kannada. The performance of the proposed system was studied and a weighted \(F_1\) scores of 0.86, 0.98, and 0.83 were achieved for Tamil, Malayalam, and Kannada Sentences from and the data set and an \(F_1\) score of 0.89 was achieved on the entire data set.