Online reviews play a key role in influencing consumer purchasing decisions and store ratings in the e-commerce world. However, the prevalence of review manipulation is a significant concern. Businesses regularly use spam reviewers or bots to either improve their reputation or harm that of their competitors. While many detection systems rely on English-language data, local languages like Bangla are largely underdeveloped. This gap is especially relevant as e-commerce grows rapidly in Bangladesh, necessitating a greater need for dependable review verification to protect consumers and businesses alike. In our study, we use multilingual transformer models on the Bengali Fake Review Detection (BFRD) dataset, which includes over 9,000 annotated reviews. We compare three models: MuRIL, selected for its pre-training on the related Indian Bengali dialect; the generative mGPT; and the lightweight Multilingual-E5. Our findings revealed that the mGPT model demonstrated exceptional capability, achieving a state-of-the-art 98% accuracy and a 95% F1-score. Following closely, MuRIL achieved an F1-score of 91%. Coming in last place, the compact Multilingual-E5 also proved its value, delivering a competitive F1-score of 88%. This result shows that mGPT works well in identifying fake reviews in Bangla. Multilingual-E5 is also a useful and scalable solution for real-world use. It also shows how important it is to have a range of transformer architectures in the digital marketplace of Bangladesh.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fake Review Detection in Low-Resource Settings with Multilingual Transformer Models: The Case of Bangla

  • Md. Anas Mahmud,
  • Alina Hasan,
  • Tajrian Mahbub,
  • Navid Hasan Rafi,
  • Rushayed Ali Faiaz

摘要

Online reviews play a key role in influencing consumer purchasing decisions and store ratings in the e-commerce world. However, the prevalence of review manipulation is a significant concern. Businesses regularly use spam reviewers or bots to either improve their reputation or harm that of their competitors. While many detection systems rely on English-language data, local languages like Bangla are largely underdeveloped. This gap is especially relevant as e-commerce grows rapidly in Bangladesh, necessitating a greater need for dependable review verification to protect consumers and businesses alike. In our study, we use multilingual transformer models on the Bengali Fake Review Detection (BFRD) dataset, which includes over 9,000 annotated reviews. We compare three models: MuRIL, selected for its pre-training on the related Indian Bengali dialect; the generative mGPT; and the lightweight Multilingual-E5. Our findings revealed that the mGPT model demonstrated exceptional capability, achieving a state-of-the-art 98% accuracy and a 95% F1-score. Following closely, MuRIL achieved an F1-score of 91%. Coming in last place, the compact Multilingual-E5 also proved its value, delivering a competitive F1-score of 88%. This result shows that mGPT works well in identifying fake reviews in Bangla. Multilingual-E5 is also a useful and scalable solution for real-world use. It also shows how important it is to have a range of transformer architectures in the digital marketplace of Bangladesh.