<p>Hyperparameter optimization (HPO) plays a crucial role in boosting the performance of machine learning models. Well-tuned hyperparameters can significantly enhance overall model performance. However, the complexity and nonlinear nature of the hyperparameter space makes it challenging for traditional optimization methods to capture interdependencies among parameters and achieve globally optimal solutions. To address this challenge, multi-task proximal policy optimization with particle filtering (MTPPO-PF) is introduced, which integrates a multi-task learning framework with proximal policy optimization to effectively model both the intrinsic dependencies and relative independence among hyperparameters. Additionally, particle filtering (PF) is employed to dynamically estimate task weights, enabling the optimizer to adaptively assess the relative importance of each hyperparameter in real time. Experimental results demonstrate that MTPPO-PF significantly outperforms existing mainstream methods across multiple tasks, offering notable advantages in optimization efficiency, accuracy, and robustness. Consequently, the approach provides an effective solution for addressing complex HPO challenges.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MTPPO-PF: multi-task proximal policy optimization with particle filters for efficient hyperparameter optimization

  • Yushan Guo,
  • Shuanghong Qu,
  • Renato De Leone,
  • Pu Li

摘要

Hyperparameter optimization (HPO) plays a crucial role in boosting the performance of machine learning models. Well-tuned hyperparameters can significantly enhance overall model performance. However, the complexity and nonlinear nature of the hyperparameter space makes it challenging for traditional optimization methods to capture interdependencies among parameters and achieve globally optimal solutions. To address this challenge, multi-task proximal policy optimization with particle filtering (MTPPO-PF) is introduced, which integrates a multi-task learning framework with proximal policy optimization to effectively model both the intrinsic dependencies and relative independence among hyperparameters. Additionally, particle filtering (PF) is employed to dynamically estimate task weights, enabling the optimizer to adaptively assess the relative importance of each hyperparameter in real time. Experimental results demonstrate that MTPPO-PF significantly outperforms existing mainstream methods across multiple tasks, offering notable advantages in optimization efficiency, accuracy, and robustness. Consequently, the approach provides an effective solution for addressing complex HPO challenges.