Reinforcement Learning-Based Optimal Control for USVs Course Tracking under Disturbances
摘要
In this paper, an optimized backstepping (OB) with disturbance observer control problem is explored for unmanned surface vessels (USVs) course tracking system. Firstly, in order to degrade the influence of external disturbance caused by wind, waves and current, a disturbance observer is applied in estimating the external disturbance and compensates for the controller, which does not require the prior knowledge of the complex marine environment. Secondly, an OB method by combining reinforcement learning (RL) with backstepping technique is developed for USVs course tracking control system. Different from other optimal methods, the OB method is to design the controller of every backstepping step to be the optimized solution of the corresponding subsystem so that the overall system control is optimized. Finally, the stability of the USVs course tracking control system is guaranteed and all signals in the closed-loop system are uniformly ultimately bounded (UUB) on the basis of the Lyapunov theory. Simulation results validate the effectiveness of the proposed method.