Hierarchical Reinforcement Learning-Based Multi-UAV Dynamic Game Cooperative Decision-Making Optimization in Game-Theoretic Frameworks
摘要
To address the challenges of complex decision-making, algorithmic convergence difficulties, and poor stability in multi-objective coordinated combat operations with multiple unmanned aerial vehicles (UAVs), this paper proposes a hierarchical reinforcement learning-based decision optimization method for dynamic game scenarios. First, an XGBoost classification model is used to categorize four distinct tactical strategies. Subsequently, based on the classification outcomes, the corresponding multi-agent deep deterministic policy gradient (MADDPG) model is selected for strategy generation. Furthermore, a strategy distillation technique is introduced to significantly reduce computational overhead and enhance decision-making speed. Experimental results demonstrate that, compared to a single MADDPG model, the proposed hierarchical reinforcement learning approach effectively mitigates convergence issues in complex tasks and provides a novel solution framework for adversarial decision-making problems.