This research introduces a novel approach for detecting cyberbullying in social media content by utilizing a hybrid framework that combines Bidirectional Encoder Representations from Transformers (BERT) with a Support Vector Machine (SVM) classifier. To optimize the SVM performance, its parameters were systematically tuned through a grid search strategy, resulting in superior handling of complex multiclass classification tasks. The proposed BERT-SVM ensemble achieved remarkable results, reaching an accuracy of 90% on the test dataset and significantly outperforming conventional machine learning and deep learning models such as CNN, LSTM, and standalone SVM. Furthermore, interpretability techniques, including Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM), and the BERT-based interpretability (BSRT) framework, were employed to analyze and explain the hybrid model’s predictions. This not only provided deeper insights into the model’s decision-making process but also enhanced the transparency of cyberbullying detection. Overall, the findings emphasize the effectiveness of integrating BERT embeddings with SVM to deliver accurate and interpretable multiclass cyberbullying detection.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An Ensemble Framework Leveraging BERT and SVM for Effective Multiclass Cyberbullying Detection

  • Puneet Sharma,
  • Ashwani Kumar Dubey,
  • G. Arjunkumar,
  • Manish Kumar,
  • Durgesh Nandan

摘要

This research introduces a novel approach for detecting cyberbullying in social media content by utilizing a hybrid framework that combines Bidirectional Encoder Representations from Transformers (BERT) with a Support Vector Machine (SVM) classifier. To optimize the SVM performance, its parameters were systematically tuned through a grid search strategy, resulting in superior handling of complex multiclass classification tasks. The proposed BERT-SVM ensemble achieved remarkable results, reaching an accuracy of 90% on the test dataset and significantly outperforming conventional machine learning and deep learning models such as CNN, LSTM, and standalone SVM. Furthermore, interpretability techniques, including Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM), and the BERT-based interpretability (BSRT) framework, were employed to analyze and explain the hybrid model’s predictions. This not only provided deeper insights into the model’s decision-making process but also enhanced the transparency of cyberbullying detection. Overall, the findings emphasize the effectiveness of integrating BERT embeddings with SVM to deliver accurate and interpretable multiclass cyberbullying detection.