Enhanced federated reinforcement learning framework for task management in fog computing using eligibility traces and targeted model dissemination
摘要
Fog computing supports low-latency coordination among distributed edge nodes, yet real deployments must cope with uncertain workloads, partial observability, and intermittent links. This study develops a federated reinforcement learning (FRL) framework designed to remain stable under such non-ideal conditions. The approach combines three complementary mechanisms: (i) multi-kernel fuzzy preprocessing to capture task semantics, (ii) eligibility-trace–based policy initialization for faster adaptation, and (iii) topology-aware dissemination that prioritizes structurally influential nodes during aggregation. Together, these components enable faster convergence, lower communication load, and improved allocation accuracy in heterogeneous fog settings. Simulations on dynamic fog topologies show consistent performance gains: convergence time shortened by 40.3% relative to classical RL, energy use reduced by 28.0% compared with baseline FRL, latency lowered by 18.8% versus GNN-FL, and accuracy improved by 11.2% over FedAvg. Communication volume decreased by roughly 41.5% compared with full-broadcast aggregation. Statistical significance was verified using one-way ANOVA and Mann–Whitney U tests