Deep Reinforcement Learning-Based Multi-objective Global Path Planning for Amphibious Unmanned Surface Vehicles
摘要
This paper presents a global path planning method based on the Deep Double Q Network (DDQN) to improve the autonomous navigation capability of amphibious unmanned aerial vehicles (AUSVs) in complex environments. First, a simulation environment is constructed using a generalized super-ellipsoid model. Second, a reinforcement learning framework is designed, including state space, action space, and reward functions tailored for time sensitive and energy sensitive tasks. An action masking mechanism is also applied to filter out infeasible actiony. Finally, a third-order Bézier curve is applied to smooth the generated path, ensuring better compliance with the motion characteristics of AUSVs. Simulation results demonstrate that the proposed method can generate suitable paths based on different task requirements and outperforms the rapidly-exploring random tree (RRT) algorithm in terms of planning performance, validating its effectiveness and superiority.