Model Slicing for Analysis of Recourse Bias with Explanation Tables
摘要
Model slicing refers to computing model-performance metrics independently for sub-groups to identify biases. As an example, a healthcare model with good overall accuracy may perform poorly for children or seniors. We extend model slicing to summarize a new type of bias: algorithmic recourse. This quantifies the ability and cost, on average, for members of sub-groups to move from an undesirable to a desirable outcome. As an example, a recourse-biased loan-approval model may show equal classification accuracy for different sub-groups; however, women whose loans were declined may need to increase their savings balance by twenty percent to receive approval, while men only require a ten-percent increase. Our solution, REACT, combines counterfactual mining, finding nearest positively labeled neighbors to a given negatively labeled example, and if-then rule mining to generate a concise summary as an explanation table of recourse bias across sub-groups. We experimentally demonstrate the value of our solution using several case studies including finance and law enforcement.