Using Local Gradient Compensation in Federated Learning for Improving Privacy and Performance
摘要
Federated learning (FL) has emerged as a leading approach for decentralized model training, preserving data privacy by exchanging only model parameters. However, recent studies have exposed vulnerabilities, revealing that attackers can reconstruct private data from shared model parameters, compromising user privacy. To address this, various defense methods have been proposed, with gradient perturbation being a lightweight yet effective strategy. However, it often incurs a trade-off with model performance. In this paper, we introduce a lightweight defense mechanism tailored for Federated Stochastic Gradient Descent (FedSGD). Our method leverages maximum gradient values to gauge noise scale, while also preserving and compensating for previous noise iterations to mitigate performance impacts.