Humanoid Robots Gate-Passing Method Based on SAC Algorithm with Generative Adversarial Networks
摘要
In recent years, humanoid robots have demonstrated significant potential in completing complex tasks in dynamic environments. Gate-passing is a challenging task that requires precise motion control and decision-making capabilities. This paper proposes a humanoid robots gate-passing method based on the Soft Actor-Critic (SAC) algorithm combined with Generative Adversarial Networks (GAN). By incorporating a GAN module to generate adversarial samples, the SAC algorithm receives additional feedback, enhancing the stability and efficiency of policy generation. Experiments conducted on the Webots simulation platform using the DarwinOP2 humanoid robots demonstrate that the GAN-SAC method significantly accelerates convergence and improves task success rates compared to traditional SAC. This study addresses the challenges of unstable policy generation and inefficient exploration in complex dynamic environments, while significantly enhancing the robot’s task adaptability in random scenarios.