Computational fairness in adaptive neural networks
摘要
Adaptive neural networks offer a promising approach to reduce the computational cost of neural network inference. These models dynamically allocate computational resources based on each individual input, leading to a significant reduction in average computational cost. In this paper, we show that adaptive computation can have unintended consequences, potentially leading to a significantly worse user experience for certain groups. We train several state-of-the-art adaptive neural networks for the task of age prediction on the FairFace dataset and demonstrate that the average computational cost varies considerably across different user demographics, including age, race and gender. Additionally, we analyze the properties of images that influence the computational cost and show that these factors partially explain the observed demographic differences in performance.