We present a comprehensive comparative analysis of different transformer models for the task of punctuation prediction in Arabic text. The models evaluated include Asafaya-BERT, XLM-RoBERTa, Google BERT Multi-lingual, AraBERT, MarBERT and AUBMindLab’s AraGPT-2. Each model’s performance was assessed using accuracy, precision and F1 score metrics across multiple punctuation marks, providing a detailed understanding of their strengths and limitations. The results highlight AraBERT and MarBERT as particularly effective for predicting Arabic punctuation, with detailed metrics demonstrating their superior performance in both general and specific punctuation scenarios. This analysis provides valuable insights for future research and practical applications in Arabic natural language processing.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Comparative Analysis of Transformer Models for the Prediction of Arabic Punctuation

  • Abdelkarim Aboutaib,
  • Ahmad El Allaoui,
  • Imad Zeroual

摘要

We present a comprehensive comparative analysis of different transformer models for the task of punctuation prediction in Arabic text. The models evaluated include Asafaya-BERT, XLM-RoBERTa, Google BERT Multi-lingual, AraBERT, MarBERT and AUBMindLab’s AraGPT-2. Each model’s performance was assessed using accuracy, precision and F1 score metrics across multiple punctuation marks, providing a detailed understanding of their strengths and limitations. The results highlight AraBERT and MarBERT as particularly effective for predicting Arabic punctuation, with detailed metrics demonstrating their superior performance in both general and specific punctuation scenarios. This analysis provides valuable insights for future research and practical applications in Arabic natural language processing.