Traditional rigid robots face limitations in exploration during learning processes in dynamic and unknown environments where contact and impacts are common. Soft robots that leverage compliant materials, for example as part of variable stiffness actuators (VSAs), offer promising avenues for enhanced adaptability and safety. Deep Reinforcement Learning (RL), while proven to be a powerful tool, requires a lot of training data that is time-consuming to gather. This paper introduces a novel approach to simulating robots driven by antagonistic VSAs, as well as full-task learning with a soft robot arm in three environments with different contact types: path following (no contact), door opening (kinematic constraint), and surface wiping (continuous contact). We show that the tendon-driven robot can learn all three tasks, even if learning in a very low-level actuation space. The stretchable tendons enables it to perform relatively well on the contact-rich tasks. Further, using the proposed variable stiffness controller the robot is able to develop a stable behaviour in terms of forces applied to the environment. The results are promising for extending the approach to the physical robot.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Contact-Rich Task Learning on an Articulated Soft Robot Arm Through Simulation

  • Laurenz Elstner,
  • Erik Kyrkjebø,
  • Martin F. Stoelen

摘要

Traditional rigid robots face limitations in exploration during learning processes in dynamic and unknown environments where contact and impacts are common. Soft robots that leverage compliant materials, for example as part of variable stiffness actuators (VSAs), offer promising avenues for enhanced adaptability and safety. Deep Reinforcement Learning (RL), while proven to be a powerful tool, requires a lot of training data that is time-consuming to gather. This paper introduces a novel approach to simulating robots driven by antagonistic VSAs, as well as full-task learning with a soft robot arm in three environments with different contact types: path following (no contact), door opening (kinematic constraint), and surface wiping (continuous contact). We show that the tendon-driven robot can learn all three tasks, even if learning in a very low-level actuation space. The stretchable tendons enables it to perform relatively well on the contact-rich tasks. Further, using the proposed variable stiffness controller the robot is able to develop a stable behaviour in terms of forces applied to the environment. The results are promising for extending the approach to the physical robot.