This paper presents a structured framework for assessing bias in facial recognition (FR) models, with an application to a case study. Bias in FR technologies towards sensitive demographic groups remains a significant challenge and a shared responsibility among researchers and companies in the design and development of fair systems. Despite increasing attention to fairness in FR, most existing studies address isolated stages of bias evaluation, with few offering an end-to-end well-defined solution. The proposed framework was developed in a structured and objective manner: 1) the selection of appropriate datasets; 2) the application of bias evaluation metrics; and 3) the techniques and the comparative analysis of performance across demographic groups. That framework aims not only to assist researchers in assessing bias in FR models but also to support the comparison and establishment of benchmarking tests for bias across different models. As a second contribution, we present a case study that applies the proposed framework to widely used benchmark datasets and relevant state-of-the-art pre-trained FR models, providing a comprehensive evaluation of performance disparities across different demographic groups.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Assessing Demographic Bias and Fairness in Facial Recognition Systems: A Framework

  • Darian S. R. Rabanni,
  • Italo A. D. Oliveira,
  • Miguel D. S. Wanderley,
  • Cinthya O. Silva,
  • Renato A. Almeida,
  • João R. Alvim,
  • Katia M. Poloni,
  • Gustavo C. Bicalho,
  • Lucas F. A. O. Pellicer

摘要

This paper presents a structured framework for assessing bias in facial recognition (FR) models, with an application to a case study. Bias in FR technologies towards sensitive demographic groups remains a significant challenge and a shared responsibility among researchers and companies in the design and development of fair systems. Despite increasing attention to fairness in FR, most existing studies address isolated stages of bias evaluation, with few offering an end-to-end well-defined solution. The proposed framework was developed in a structured and objective manner: 1) the selection of appropriate datasets; 2) the application of bias evaluation metrics; and 3) the techniques and the comparative analysis of performance across demographic groups. That framework aims not only to assist researchers in assessing bias in FR models but also to support the comparison and establishment of benchmarking tests for bias across different models. As a second contribution, we present a case study that applies the proposed framework to widely used benchmark datasets and relevant state-of-the-art pre-trained FR models, providing a comprehensive evaluation of performance disparities across different demographic groups.