Reinforcement Learning Applications in Unmanned Underwater Vehicles: A Review
摘要
The ocean, which is a key component of Earth’s ecosystem, requires advanced technologies for deep and highly comprehensive exploration. Unmanned underwater vehicles (UUVs) play an important role in this task, but their development encounters great challenges due to the complex and dynamic underwater environment. Reinforcement learning (RL) has recently emerged as a promising method to improve the capabilities of UUVs. This study comprehensively reviews the implementations of RL in UUVs, with a focus on key tasks such as motion planning, navigation and control, and multiagent coordination. We investigate current difficulties and emerging trends, as illustrated by a case study. This review aims to provide a foundation for RL-based control and decision-making in UUVs and offer actionable insights for advancing studies in this rapidly evolving domain.