The swift progress of large language models (LLMs), such as OpenAI’s GPT series, Google’s Gemini, and Anthropic’s Claude, has been observed to revolutionize the field of natural language processing by enabling machines to generate text that has become almost indistinguishable from human-authored content. This advancement has introduced significant challenges in the detection of AI-generated texts, which is essential for upholding academic integrity, ensuring trustworthy information dissemination, and maintaining digital transparency. Recognizing that even experienced AI users have often faced difficulties in differentiating such content, a comparative evaluation of seven machine learning algorithms has been presented to assess their capability to identify AI-generated texts. Conventional models, including Naive Bayes, Random Forest, K-Nearest Neighbors (KNN), and Decision Trees, have demonstrated accuracy rates of 96%, 90%, 63%, and 80%, respectively. The Multi-Layer Perceptron (MLP) has achieved 94% accuracy and a 95% F1 score, while the RoBERTa transformer model has outperformed all, reaching 97% accuracy with a 97% F1 score. The newly included BiLSTM model has achieved 95% accuracy, demonstrating competitive performance. Additionally, evaluations on paraphrased and multilingual datasets have been performed to assess robustness under challenging conditions. These findings have highlighted the effectiveness of advanced neural network architectures in detecting AI-generated content and have provided a foundation for developing reliable, scalable, and ethical AI detection solutions for practical applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Detecting AI-Generated Text Using Machine Learning: A Comparative Study of MLP and RoBERTa-Based Models

  • Tahnia Binte Shafi,
  • Toaha Siddique,
  • Farzana Tasnim,
  • Shefayatuj Johara Chowdhury,
  • Mohammad Saeed Hasan Chowdhury,
  • Tanjim Mahmud,
  • Kaushik Deb,
  • Mohammad Shahadat Hossain,
  • Abubokor Hanip

摘要

The swift progress of large language models (LLMs), such as OpenAI’s GPT series, Google’s Gemini, and Anthropic’s Claude, has been observed to revolutionize the field of natural language processing by enabling machines to generate text that has become almost indistinguishable from human-authored content. This advancement has introduced significant challenges in the detection of AI-generated texts, which is essential for upholding academic integrity, ensuring trustworthy information dissemination, and maintaining digital transparency. Recognizing that even experienced AI users have often faced difficulties in differentiating such content, a comparative evaluation of seven machine learning algorithms has been presented to assess their capability to identify AI-generated texts. Conventional models, including Naive Bayes, Random Forest, K-Nearest Neighbors (KNN), and Decision Trees, have demonstrated accuracy rates of 96%, 90%, 63%, and 80%, respectively. The Multi-Layer Perceptron (MLP) has achieved 94% accuracy and a 95% F1 score, while the RoBERTa transformer model has outperformed all, reaching 97% accuracy with a 97% F1 score. The newly included BiLSTM model has achieved 95% accuracy, demonstrating competitive performance. Additionally, evaluations on paraphrased and multilingual datasets have been performed to assess robustness under challenging conditions. These findings have highlighted the effectiveness of advanced neural network architectures in detecting AI-generated content and have provided a foundation for developing reliable, scalable, and ethical AI detection solutions for practical applications.