Bangla (Bengali) is among the world’s most spoken languages, although no research has explored the model bias of its NLP. This paper investigates the model bias in Bangla text classification empirically, using critical fairness measures such as Demographic Parity, Equalized Odds and Accuracy Parity. We compare the performance of baseline machine learning models (Support Vector Machine, Random Forest) with deep models such as LSTM and Bangla-BERT for a large publicly available sentiment analysis data set. Every model is shown to possess quantifiable bias, the highest baseline fairness of which is that of Bangla-BERT. We establish that the use of targeted bias reduction methods makes a striking difference in improving fairness for all models. A high-resolution error analysis uncovers misclassification in the shape of skewed social and cultural assumptions embedded in the biased class distribution of data. This paper presents a unique comparison of Bangla NLP bias and provides insightful and practical suggestions for creating more fair and ethical AI systems for low-resource languages.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Analyzing and Mitigating Linguistic Bias in Bangla Natural Language Processing

  • Asma Akter,
  • Md. Istiak Tanvir,
  • Tanvirul Islam,
  • Johir Ahemmod Chowduri,
  • Md. Badsha Fahadh,
  • Md. Abir Ul Islam,
  • Rabeya Alam

摘要

Bangla (Bengali) is among the world’s most spoken languages, although no research has explored the model bias of its NLP. This paper investigates the model bias in Bangla text classification empirically, using critical fairness measures such as Demographic Parity, Equalized Odds and Accuracy Parity. We compare the performance of baseline machine learning models (Support Vector Machine, Random Forest) with deep models such as LSTM and Bangla-BERT for a large publicly available sentiment analysis data set. Every model is shown to possess quantifiable bias, the highest baseline fairness of which is that of Bangla-BERT. We establish that the use of targeted bias reduction methods makes a striking difference in improving fairness for all models. A high-resolution error analysis uncovers misclassification in the shape of skewed social and cultural assumptions embedded in the biased class distribution of data. This paper presents a unique comparison of Bangla NLP bias and provides insightful and practical suggestions for creating more fair and ethical AI systems for low-resource languages.