Toxic comment identification in Hinglish (a combination of Hindi and English) is a difficult task because of code-switching, transliteration, and class imbalance. This paper suggests a machine learning based method for identifying toxic Hinglish comments based on TF-IDF feature extraction along with an ensemble model. In order to mitigate class imbalance, Random Oversampling was utilized, and model interpretability was facilitated using SHAP (Shapley Additive Explanations). The suggested model was trained on publicly released datasets, with 90.0% accuracy compared to individual classifiers. This work contributes to content moderation system for code-mixed languages and offer an extensible solution for social media toxicity detection.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Toxic Hinglish Comment Detection

  • Gopal D. Upadhye,
  • Deepak T. Mane,
  • Devang Gentyal,
  • Chetan Channa,
  • Shubham Landge,
  • Radhika Gadewar

摘要

Toxic comment identification in Hinglish (a combination of Hindi and English) is a difficult task because of code-switching, transliteration, and class imbalance. This paper suggests a machine learning based method for identifying toxic Hinglish comments based on TF-IDF feature extraction along with an ensemble model. In order to mitigate class imbalance, Random Oversampling was utilized, and model interpretability was facilitated using SHAP (Shapley Additive Explanations). The suggested model was trained on publicly released datasets, with 90.0% accuracy compared to individual classifiers. This work contributes to content moderation system for code-mixed languages and offer an extensible solution for social media toxicity detection.