The collaborative patrol of AUV swarms is of great significance for maintaining the security of sensitive sea areas. Conducting research on dispatching strategies and achieving sustainable patrols is of great importance. This paper establishes a collaborative patrol model for AUV swarms based on Double Deep Q-networks (DDQN). Firstly, by defining the absolute importance of each area and building a non-homogeneous task environment map, the patrol problem is transformed into a Non-homogeneous Patrolling Problem (NHPP). The Gaussian distribution function is used to initialize the original map to obtain the importance map. Secondly, elements such as states, actions, and rewards in the non-homogeneous patrol model were established. A patrol model was constructed based on the DDQN learning algorithm to achieve regular patrols of sensitive and important areas. Finally, the effectiveness of the non-homogeneous patrol method was verified through simulation experiments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An AUV Swarm Collaborative Search Method Based on Double Deep Q-Network

  • Wenjie Li,
  • Sijia Xia,
  • Chunjia Zhu,
  • Jian Gao,
  • Yimin Chen,
  • Zhao Wang

摘要

The collaborative patrol of AUV swarms is of great significance for maintaining the security of sensitive sea areas. Conducting research on dispatching strategies and achieving sustainable patrols is of great importance. This paper establishes a collaborative patrol model for AUV swarms based on Double Deep Q-networks (DDQN). Firstly, by defining the absolute importance of each area and building a non-homogeneous task environment map, the patrol problem is transformed into a Non-homogeneous Patrolling Problem (NHPP). The Gaussian distribution function is used to initialize the original map to obtain the importance map. Secondly, elements such as states, actions, and rewards in the non-homogeneous patrol model were established. A patrol model was constructed based on the DDQN learning algorithm to achieve regular patrols of sensitive and important areas. Finally, the effectiveness of the non-homogeneous patrol method was verified through simulation experiments.