With the development of science and technology, quadruped robots have shown excellent athletic ability on various terrains through reinforcement learning (RL). Compared with the traditional model-based algorithm, RL is not limited by accurate modeling and has better environmental adaptability. Therefore, this paper introduces a path planning method for quadruped robots traversing risky terrains which have non-continuous footholds based on reinforcement learning. Firstly, the kinematics model and the static stability of the robot are analyzed. Meanwhile, non-continuous foothold terrains are concretized as plum piles, whose simulation model satisfying the robot’s motion constraints is established. Then, the feasible footholds of the quadruped robot walking on the plum pile are selected through Markov decision process. Finally, the global path planning of the body centroid is obtained by the Deep Deterministic Policy Gradient (DDPG) algorithm. Through simulation, the effectiveness of this method is verified, achieving path planning for quadruped robots under the constraints of non-continuous foothold terrains.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Reinforcement Learning Based Path Planning for Quadruped Robot on Non-continuous Foothold Terrains

  • Zhijing Ke,
  • Hongxu Ma

摘要

With the development of science and technology, quadruped robots have shown excellent athletic ability on various terrains through reinforcement learning (RL). Compared with the traditional model-based algorithm, RL is not limited by accurate modeling and has better environmental adaptability. Therefore, this paper introduces a path planning method for quadruped robots traversing risky terrains which have non-continuous footholds based on reinforcement learning. Firstly, the kinematics model and the static stability of the robot are analyzed. Meanwhile, non-continuous foothold terrains are concretized as plum piles, whose simulation model satisfying the robot’s motion constraints is established. Then, the feasible footholds of the quadruped robot walking on the plum pile are selected through Markov decision process. Finally, the global path planning of the body centroid is obtained by the Deep Deterministic Policy Gradient (DDPG) algorithm. Through simulation, the effectiveness of this method is verified, achieving path planning for quadruped robots under the constraints of non-continuous foothold terrains.