In federated learning, devices and edge server can jointly train a global model to mine data distributed on different devices. However, the model transmission between them consumes lots of network communication resources. Data heterogeneity and heterogeneous computation capacity cause slow convergence of model and low accuracy. To solve these problems, a cluster selection enhanced federated learning method named FedCS is proposed. Using dynamic clustering method kmeans++, FedCS divides devices with similar data distribution into the same group and performs unbiased sampling. A regularization term is added to prevent the local model from betraying the global model. We distinguish the heterogeneous computation capacity of devices based on dot product between local model updates and aggregated model updates from the same group. Each device is selected dynamically based on the dot product. Simulation results show that FedCS achieves higher accuracy and less communication rounds compared to FedAvg, FedProx, FedNova and FedMMD.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Communication-Concerned Federated Learning Framework Based on Clustering Selection

  • Weifeng Sun,
  • Ailian Wang,
  • Zunjing Gao,
  • Yipeng Zhou

摘要

In federated learning, devices and edge server can jointly train a global model to mine data distributed on different devices. However, the model transmission between them consumes lots of network communication resources. Data heterogeneity and heterogeneous computation capacity cause slow convergence of model and low accuracy. To solve these problems, a cluster selection enhanced federated learning method named FedCS is proposed. Using dynamic clustering method kmeans++, FedCS divides devices with similar data distribution into the same group and performs unbiased sampling. A regularization term is added to prevent the local model from betraying the global model. We distinguish the heterogeneous computation capacity of devices based on dot product between local model updates and aggregated model updates from the same group. Each device is selected dynamically based on the dot product. Simulation results show that FedCS achieves higher accuracy and less communication rounds compared to FedAvg, FedProx, FedNova and FedMMD.