FQL: a fuzzy Q-learning framework for reinforcement-driven clustering in flying Ad Hoc networks
摘要
Flying Ad Hoc Networks (FANETs), composed of unmanned aerial vehicles (UAVs), provide a flexible and rapidly deployable platform for remote data collection and mission-critical operations. However, their performance is severely challenged by high node mobility, frequent topology variations, and stringent energy constraints. These characteristics make efficient network organization particularly difficult, especially for clustering mechanisms. In this context, the cluster head (CH) election problem can be formulated as an NP-hard combinatorial optimization task, requiring adaptive and computationally efficient solutions capable of handling dynamic and uncertain environments. This work introduces a distributed Fuzzy Q-Learning (FQL) clustering framework that integrates the short-term responsiveness of Fuzzy Logic (FL) with the long-term adaptivity of Q-Learning (QL). While the FL controller evaluates CH suitability using multi-criteria metrics, the QL optimizer refines these decisions over time to learn energy-efficient policies. Extensive simulations demonstrate that the FQL framework significantly outperforms LEACH, ESOFCluster (FL-only), and QL-Clustering across all stability, energy, and reliability metrics. Quantitatively, FQL maintains a Packet Delivery Ratio (PDR) of 85–90% even under extreme mobility (30 m/s) and high density (