<p>In federated learning of autonomous vehicles, the existence of non-independence and imbalance in the participants' data seriously affects the reduction of model precision and increases fluctuation during the learning process. Such a problem becomes most serious when the distribution of the data among the participants is highly uneven. Based on loss history and exponential weighting, a new algorithm was proposed called EWHFed (Exponential Moving Average in Federated Learning). It takes as input the loss history of the last n rounds, multiplies it by the normalized error of each participant and the gradient he sends to the learner. In such a manner, the algorithm avoids sudden weight updates; this improves both the convergence bound and the actual convergence rate. Furthermore, explicit and implicit exponential weighting for fairness in the learning process allows participants with imbalanced datasets to perform even better. For performance evaluation, the algorithm was tested on the KITTI and GTSRB datasets. From the performance results obtained, the proposed algorithm attained accuracy about 3% higher than the classic FedAvg. Besides, the variance in accuracy by the proposed algorithm is 400 units lower on the KITTI dataset and 300 units lower on the GTSRB dataset compared to other algorithms. It has not only indicated superior stability but also improved fairness towards participants whose data is distributed unevenly.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fairness-based federated learning in autonomous vehicles with exponential moving average loss weighting

  • Amir Mollanejad,
  • Ali Ghaffari,
  • Amir Seyyedabbasi,
  • Ahmad Habibizad Navin

摘要

In federated learning of autonomous vehicles, the existence of non-independence and imbalance in the participants' data seriously affects the reduction of model precision and increases fluctuation during the learning process. Such a problem becomes most serious when the distribution of the data among the participants is highly uneven. Based on loss history and exponential weighting, a new algorithm was proposed called EWHFed (Exponential Moving Average in Federated Learning). It takes as input the loss history of the last n rounds, multiplies it by the normalized error of each participant and the gradient he sends to the learner. In such a manner, the algorithm avoids sudden weight updates; this improves both the convergence bound and the actual convergence rate. Furthermore, explicit and implicit exponential weighting for fairness in the learning process allows participants with imbalanced datasets to perform even better. For performance evaluation, the algorithm was tested on the KITTI and GTSRB datasets. From the performance results obtained, the proposed algorithm attained accuracy about 3% higher than the classic FedAvg. Besides, the variance in accuracy by the proposed algorithm is 400 units lower on the KITTI dataset and 300 units lower on the GTSRB dataset compared to other algorithms. It has not only indicated superior stability but also improved fairness towards participants whose data is distributed unevenly.