This study explores the integration of the Kolmogorov-Arnold Network (KAN) model into continuous reinforcement learning (CRL). We incorporate KAN and its improved variant, MultKAN, into the on-policy PPO algorithm, resulting in a new approach called KAN-PPO. Using the Mujoco Half-cheetah environment, we conduct extensive experiments to compare the performance and generalization of KAN-PPO models against MLP-PPO structures. Additionally, we examine the effects of dropout regularization through the DropKAN method in dense network settings. Our findings demonstrate the effectiveness of KAN and MultKAN models in CRL, highlighting their potential for complex learning tasks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

KAN-Based On-Policy PPO Method for Continuous Reinforcement Learning

  • Ali Bayeh,
  • Malek Mouhoub,
  • Samira Sadaoui

摘要

This study explores the integration of the Kolmogorov-Arnold Network (KAN) model into continuous reinforcement learning (CRL). We incorporate KAN and its improved variant, MultKAN, into the on-policy PPO algorithm, resulting in a new approach called KAN-PPO. Using the Mujoco Half-cheetah environment, we conduct extensive experiments to compare the performance and generalization of KAN-PPO models against MLP-PPO structures. Additionally, we examine the effects of dropout regularization through the DropKAN method in dense network settings. Our findings demonstrate the effectiveness of KAN and MultKAN models in CRL, highlighting their potential for complex learning tasks.