Recently, Personalized Federated learning (PFL) has attracted much attention because it can effectively solve data heterogeneity and realize personalized models. Mainstream methods generate personalized models by weighted aggregation based on weights calculated from inter-client losses or parameter differences. However, these methods have been improved in performance, but there are still shortcomings in the processing of data heterogeneity and model generalization. In this paper, we propose a novel PFL method, pFLAWC. Firstly, pFLAWC utilizes Residual Attention Synergy Module(RASM) to deal with heterogeneity and better learn personalized feature information of clients. Secondly, the distance between the user’s personalized information and the global information was reflected by the guidance model. Finally, the proposed model uses Adaptive Top-K Aggregation mechanism to dynamically aggregate the model parameters collected from the client to obtain a personalized model. We conduct extensive experiments using three real-world datasets and show that pFLAWC outperforms 14 state-of-the-art methods in terms of effectiveness, scalability, and stability. Furthermore, pFLAWC alleviates the generalization problem and achieves up to 4.08% relative improvement in accuracy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Personalized Federated Learning with Adaptive Weight Clustering

  • Rou Zhou,
  • Yuling Chen,
  • Hui Dou,
  • Haolang Feng,
  • Long Chen

摘要

Recently, Personalized Federated learning (PFL) has attracted much attention because it can effectively solve data heterogeneity and realize personalized models. Mainstream methods generate personalized models by weighted aggregation based on weights calculated from inter-client losses or parameter differences. However, these methods have been improved in performance, but there are still shortcomings in the processing of data heterogeneity and model generalization. In this paper, we propose a novel PFL method, pFLAWC. Firstly, pFLAWC utilizes Residual Attention Synergy Module(RASM) to deal with heterogeneity and better learn personalized feature information of clients. Secondly, the distance between the user’s personalized information and the global information was reflected by the guidance model. Finally, the proposed model uses Adaptive Top-K Aggregation mechanism to dynamically aggregate the model parameters collected from the client to obtain a personalized model. We conduct extensive experiments using three real-world datasets and show that pFLAWC outperforms 14 state-of-the-art methods in terms of effectiveness, scalability, and stability. Furthermore, pFLAWC alleviates the generalization problem and achieves up to 4.08% relative improvement in accuracy.