Gradient descent-based lightweight federated learning model for differential privacy-preserving
摘要
In response to potential user privacy issues that may arise during machine learning processes, federated learning, as the first collaborative and online learning solution without requiring users to upload real data and only uploading model updates, has garnered widespread attention and research. However, model updates that users train locally and upload can still potentially contain sensitive information, raising new privacy protection concerns. Additionally, the need for users to perform extensive local training introduces computational and communication overhead, posing a challenge that necessitates the development of a lightweight federated learning architecture. Considering further privacy requirements, this paper employs a federated learning framework with differential privacy mechanisms. Moreover, it introduces for the first time a Dropout mechanism based on the Fisher information matrix Fisher Dropout to enhance the balance between privacy and efficiency in federated learning. Extensive experiments on real-world datasets validate the effectiveness of the proposed solution. The experimental results demonstrate that, compared to other federated learning methods, this approach exhibits significant advantages in balancing privacy protection and usability.