We investigate the fairness of local explanations in AI models by comparing the mean explanations for privileged and unprivileged groups across various datasets and model types. Specifically, we train linear, multi-layer perceptron, and explainable boosting machine (EBM) models, on several key academic datasets. Local explanations are generated using both post-hoc methods (LIME), and direct methods - logistic regression, integrated gradients and EBM local feature importance. By comparing these explanations across models and methods, we introduce a new metric, the Local Explanation Amplification Disparity Ratio (LEADR), to measure disparities in feature attribution between privileged and unprivileged groups. Our preliminary findings suggest that transparent Whitebox models may exhibit a tendency to display greater disparity in bias than opaque Blackbox models. This insight encourages further research into bias mitigation strategies that are tailored to different algorithm types, with the goal of minimizing undesired bias in AI systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Measuring Fairness in AI Explanations with LEADR: Local Explanation Amplification Disparity Ratio

  • Niloufar Shoeibi,
  • Jonathan DeGange,
  • Nastaran Shoeibi,
  • Ali Shoeibi

摘要

We investigate the fairness of local explanations in AI models by comparing the mean explanations for privileged and unprivileged groups across various datasets and model types. Specifically, we train linear, multi-layer perceptron, and explainable boosting machine (EBM) models, on several key academic datasets. Local explanations are generated using both post-hoc methods (LIME), and direct methods - logistic regression, integrated gradients and EBM local feature importance. By comparing these explanations across models and methods, we introduce a new metric, the Local Explanation Amplification Disparity Ratio (LEADR), to measure disparities in feature attribution between privileged and unprivileged groups. Our preliminary findings suggest that transparent Whitebox models may exhibit a tendency to display greater disparity in bias than opaque Blackbox models. This insight encourages further research into bias mitigation strategies that are tailored to different algorithm types, with the goal of minimizing undesired bias in AI systems.