A Spam Detection Model With Federated Learning and Large Language Model
摘要
This paper investigates the application of large language models (LLMs) in email anomaly detection, proposing a federated learning framework that integrates RoBERTa’s advanced semantic capabilities with differential privacy and a dynamic reputation mechanism to address privacy and security challenges. Our approach employs adapter modules for parameter-efficient fine-tuning, enabling localized model adaptation without compromising data privacy. The framework is evaluated across four diverse datasets, demonstrating robust performance comparable to centralized models while ensuring resilience against adversarial interference. Experimental results highlight the potential of federated LLMs as a scalable and privacy-preserving solution for email anomaly detection, particularly in scenarios with limited labeled data and frequent model updates.