Transformers and Deep Learning Models for Hate Speech Detection in the Dialects Arabic Language
摘要
The internet has transformed the world into a smart city, but one must ask: what is truly at the core of this digital society? Is it built on a foundation of respect, or does it breed chaos? The anonymity that the internet provides has led to a significant rise in hate speech and offensive language, particularly among young people. In This paper we develop an efficient offensive speech recognition model for the Arabic dialect language. To achieve this, we created a dataset combining Modern Standard Arabic with Levantine, Algerian, and Moroccan dialects. This resulted in a corpus of 33,120 utterance, each labeled as offensive or non-offensive. We conducted extensive experiments to identify the best approach for feature extraction, comparing neural network-based embedding techniques (Word2Vec, Doc2Vec, Sent2Vec) with transformer-based methods (Google BERT, AraBERT, Sentence Transformers, OpenAI). We also evaluated various classifiers, including classical and advanced algorithms. The best performance was achieved using the AraBERT embedding approach with a CNN classifier. The model achieved an impressive 8% error rate, demonstrating its effectiveness and precision, leveraging transformer-based embeddings, which is the current SOTA in the text mining field. Our model outperforms existing research in Arabic, reducing the error rate by ≈ 5%.