This paper investigates the cooperative active defense guidance problem in an “evader-pursuer-defender” multi-role game scenario. In practical applications, the hypersonic vehicle and active defender face significant challenges due to uncertain, incomplete, discontinuous and delayed (UID2) information, complicating the evader’s escape. To tackle these issues, a cooperative active defense guidance based on a value decomposition multi-agent reinforcement learning (MARL) algorithm is proposed. First, a reward function is designed specifically for the multi-role cooperative mission, aligning with vehicle maneuverability and game relationships. This helps improve algorithm convergence during training in dynamic and adversarial game scenarios and overcome the limitations of sparse and potentially deceptive reward functions. Second, to handle the spatiotemporal characteristics of the UID2 information, an information processing mechanism is developed to transform detection data into a multi-agent observation set, providing robust support for decision-making. Additionally, an improved value decomposition Qmix-based network architecture is designed to facilitate cooperative strategies during training and enable independent decision-making, guiding the evader and defender in coordinated maneuvers. Finally, the effectiveness of the proposed method is validated through numerical simulations.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Cooperative Active Defense Guidance for Hypersonic Vehicles Under Multiple Information Constraints

  • Peihuan Qiu,
  • Jinglan Zeng,
  • Weilin Ni,
  • Haizhao Liang

摘要

This paper investigates the cooperative active defense guidance problem in an “evader-pursuer-defender” multi-role game scenario. In practical applications, the hypersonic vehicle and active defender face significant challenges due to uncertain, incomplete, discontinuous and delayed (UID2) information, complicating the evader’s escape. To tackle these issues, a cooperative active defense guidance based on a value decomposition multi-agent reinforcement learning (MARL) algorithm is proposed. First, a reward function is designed specifically for the multi-role cooperative mission, aligning with vehicle maneuverability and game relationships. This helps improve algorithm convergence during training in dynamic and adversarial game scenarios and overcome the limitations of sparse and potentially deceptive reward functions. Second, to handle the spatiotemporal characteristics of the UID2 information, an information processing mechanism is developed to transform detection data into a multi-agent observation set, providing robust support for decision-making. Additionally, an improved value decomposition Qmix-based network architecture is designed to facilitate cooperative strategies during training and enable independent decision-making, guiding the evader and defender in coordinated maneuvers. Finally, the effectiveness of the proposed method is validated through numerical simulations.