Towards efficient and secure vertical federated learning with additive ensemble
摘要
The FL enables collaboratively training deep learning models on decentralized data. However, the current framework of FL, specifically the VFL framework, faces various challenges, such as subpar performance and safety concerns. Regrettably, these challenges have received limited attention within the existing research literature. In this study, we propose a novel VFL paradigm within VFL called AE-VFL, which improves the performance and safety of VFL by integrating gradient boosting into it. AE-VFL treats each local model within the participant as a sub-model and trains them sequentially to fit the gradient of the loss function derived from previous models. This approach leverages each sub-model to compensate for the limitations of its predecessors. Notably, each participant does not directly access the gradients of the ground-truth labels, which contain sensitive information. This mechanism ensures the performance and security of AE-VFL. Experimental results demonstrate that AE-VFL achieves superior performance and security compared to alternative approaches in a typical VFL setting. Furthermore, each participant benefits from AE-VFL’s utilization across various models and tasks. To facilitate the reproduction of this work, we have made the code for this project publicly available. You can access it via the following link: https://github.com/WOW5678/Towards-Efficient-and-Secure-Vertical-Federated-Learning-with-Additive-Ensemble.