The use of recruitment systems is on the rise, which in turn raises concerns about their fairness, specifically regarding gender discrimination. This study aims to identify whether or not machine learning models and pretrained NLP models cause gender discrimination in the screening of CVs. For this, CVs were created synthetically with male and female markers in the data, keeping the qualifications strictly balanced. Random-Forest, Logistic-Regression, and pretrained NLP-based classifiers were trained on this data. Although qualifications were strictly balanced, male bias was demonstrated by models trained on synthetic data with values ranging from 1.24 to 1.49 and p-values below 0.001. This type of result is important because it shows how systematic bias may be hidden in algorithms that were designed with good intent, especially in AI hiring tools. This raises the urgency of ethical and fairness designs in algorithms.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Analyzing Gender Bias in Resume Screening with Synthetic Data and Pretrained NLP Models

  • Iyer Jagannath Ramu,
  • Jossy George,
  • Pawan Kumar

摘要

The use of recruitment systems is on the rise, which in turn raises concerns about their fairness, specifically regarding gender discrimination. This study aims to identify whether or not machine learning models and pretrained NLP models cause gender discrimination in the screening of CVs. For this, CVs were created synthetically with male and female markers in the data, keeping the qualifications strictly balanced. Random-Forest, Logistic-Regression, and pretrained NLP-based classifiers were trained on this data. Although qualifications were strictly balanced, male bias was demonstrated by models trained on synthetic data with values ranging from 1.24 to 1.49 and p-values below 0.001. This type of result is important because it shows how systematic bias may be hidden in algorithms that were designed with good intent, especially in AI hiring tools. This raises the urgency of ethical and fairness designs in algorithms.