A Lightweight Federated Learning Framework for Resource-Constrained Devices Using Knowledge Distillation in Ambient IoT Environments
摘要
The research proposes an Efficient Federated Learning System with Integrated Knowledge Distillation that can be deployed to constrained Ambient IoT environments. Locally trained autonomous client models and the overall combined global model were determined by federated averaging on the Edge-IIoT dataset, which has been split into 10 clients. The test accuracy of 92.65% and the AUC of 0.8729 were obtained by the produced global model prior to the knowledge distillation phase. Afterwards, a condensed student model to facilitate the optimum deployment on the terminal devices were distilled by the produced global model, which produced the test accuracy of 85.87% and the AUC of 0.8727. The experimental result verifies that the proposed system has high predictive accuracy with high compression of the model that can be efficiently and scalably deployed on low-power IoT devices.