Scholarlink

<p>This paper proposes virtual impedance adaptation of the lower-limb exoskeleton for human performance augmentation (LEHPA) based on deep reinforcement learning (VIADRL) to mitigate reliance on model accuracy and address the ever-changing human-exoskeleton interaction (HEI) dynamics. The classical sensitivity amplification control strategy is expanded to the virtual impedance control strategy with more learnable virtual impedance parameters. The adjustment of these virtual impedance parameters is formalized as finding the optimal policy for a Markov Decision Process and can then be effectively resolved using deep reinforcement learning algorithms. To ensure safe and efficient policy training, a multibody simulation environment is established to facilitate the training process, supplemented by the innovative hybrid inverse-forward dynamics simulation approach for executing the simulation. For comparison purposes, the SADRL strategy is introduced as a benchmark. A novel control performance evaluation method based on the HEI forces at the back, thighs, and shanks is proposed to quantitatively evaluate the performance of our proposed VIADRL strategy. The VIADRL controller is systematically compared with the SADRL controller at five selected walking speeds. The lumped ratio of HEI forces under the SADRL strategy relative to those under the SADRL strategy is as low as 0.81 in simulation and approximately 0.89 on the LEHPA prototype. The overall reduction of HEI forces demonstrates the superiority of the VIADRL strategy in comparison to the SADRL strategy.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Virtual Impedance Adaptation of Lower-Limb Exoskeleton for Human Performance Augmentation Based on Deep Reinforcement Learning

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年10月9日

查看全文
  • Ranran Zheng,
  • Zhiyuan Yu,
  • Hongwei Liu,
  • Junqin Lin,
  • Bo Zeng,
  • Longfei Jia

摘要

This paper proposes virtual impedance adaptation of the lower-limb exoskeleton for human performance augmentation (LEHPA) based on deep reinforcement learning (VIADRL) to mitigate reliance on model accuracy and address the ever-changing human-exoskeleton interaction (HEI) dynamics. The classical sensitivity amplification control strategy is expanded to the virtual impedance control strategy with more learnable virtual impedance parameters. The adjustment of these virtual impedance parameters is formalized as finding the optimal policy for a Markov Decision Process and can then be effectively resolved using deep reinforcement learning algorithms. To ensure safe and efficient policy training, a multibody simulation environment is established to facilitate the training process, supplemented by the innovative hybrid inverse-forward dynamics simulation approach for executing the simulation. For comparison purposes, the SADRL strategy is introduced as a benchmark. A novel control performance evaluation method based on the HEI forces at the back, thighs, and shanks is proposed to quantitatively evaluate the performance of our proposed VIADRL strategy. The VIADRL controller is systematically compared with the SADRL controller at five selected walking speeds. The lumped ratio of HEI forces under the SADRL strategy relative to those under the SADRL strategy is as low as 0.81 in simulation and approximately 0.89 on the LEHPA prototype. The overall reduction of HEI forces demonstrates the superiority of the VIADRL strategy in comparison to the SADRL strategy.