This study systematically evaluated the gender bias performance of three English high-resource LLM (GPT-4o, Claude, and Gemini) and three Chinese high-resource LLM (Model 1, Model 2, and Model 3) in two language environments: English and Chinese, using four evaluation methods: Occupation Description, Simulated Workplace Recruitment, Occupational Story Generation, and Pronoun Coreference Resolution. The results showed that the English High-Resource LLM was biased toward males in Chinese responses and more gender-balanced or biased toward females in English responses, while the Chinese High-Resource LLM was significantly biased toward males in both linguistic contexts. The chi-square test results further confirmed the statistical significance of these differences, revealing the profound influence of model training data and cultural context on gender bias. To facilitate gender bias research and fairness improvement, this study open-sources all data and code to promote further research ( https://github.com/GZHU-Innovation-Intersection-Lab/LLMGenderBias ).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Exploring Occupational Gender Bias in Large Language Models of High-Resource Language

  • Kun Jia,
  • Zekun Liu,
  • Daixi Zhang,
  • Huimei Chen,
  • Fuxian Luo,
  • Jiayin Qi

摘要

This study systematically evaluated the gender bias performance of three English high-resource LLM (GPT-4o, Claude, and Gemini) and three Chinese high-resource LLM (Model 1, Model 2, and Model 3) in two language environments: English and Chinese, using four evaluation methods: Occupation Description, Simulated Workplace Recruitment, Occupational Story Generation, and Pronoun Coreference Resolution. The results showed that the English High-Resource LLM was biased toward males in Chinese responses and more gender-balanced or biased toward females in English responses, while the Chinese High-Resource LLM was significantly biased toward males in both linguistic contexts. The chi-square test results further confirmed the statistical significance of these differences, revealing the profound influence of model training data and cultural context on gender bias. To facilitate gender bias research and fairness improvement, this study open-sources all data and code to promote further research ( https://github.com/GZHU-Innovation-Intersection-Lab/LLMGenderBias ).