The marine predator algorithm (MPA) often struggles with issues such as low population diversity, susceptibility to local optima, and population aggregation when optimizing XGBoost, which is sensitive to numerous parameters. To address these challenges, we propose the dual-population-iterating and prey-gathering marine predator algorithm (DPGMPA) and apply it to XGBoost parameter optimization. Initially, we utilize a dual-population-iterating strategy to create the original population and an opposition-based learning population. Brownian motion and Laplace distribution respectively control the step size to guide population updates toward the global optimum, enhancing population diversity. Subsequently, the preys-gathering strategy is employed, selecting prey with the highest accuracy in each iteration and having neighboring preys converge towards them to mitigate local optima. Furthermore, we optimize the Fish Aggregating Devices (FADs) by introducing variable weight control, addressing the population aggregation issue. To validate the parameter optimization capability of this algorithm for XGBoost, we conducted experiments on six datasets, using accuracy and F1 score as evaluation metrics, and compared the results with five other algorithms. The experimental results demonstrate that the DPGMPA algorithm more effectively escapes local optima when optimizing the XGBoost classifier, significantly improving XGBoost's classification performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Dual-Population-Iterating and Preys-Gathering MPA for XGBoost Optimization

  • Jiacheng Li,
  • Li Lv,
  • Ping Kang,
  • Xiumei Tian

摘要

The marine predator algorithm (MPA) often struggles with issues such as low population diversity, susceptibility to local optima, and population aggregation when optimizing XGBoost, which is sensitive to numerous parameters. To address these challenges, we propose the dual-population-iterating and prey-gathering marine predator algorithm (DPGMPA) and apply it to XGBoost parameter optimization. Initially, we utilize a dual-population-iterating strategy to create the original population and an opposition-based learning population. Brownian motion and Laplace distribution respectively control the step size to guide population updates toward the global optimum, enhancing population diversity. Subsequently, the preys-gathering strategy is employed, selecting prey with the highest accuracy in each iteration and having neighboring preys converge towards them to mitigate local optima. Furthermore, we optimize the Fish Aggregating Devices (FADs) by introducing variable weight control, addressing the population aggregation issue. To validate the parameter optimization capability of this algorithm for XGBoost, we conducted experiments on six datasets, using accuracy and F1 score as evaluation metrics, and compared the results with five other algorithms. The experimental results demonstrate that the DPGMPA algorithm more effectively escapes local optima when optimizing the XGBoost classifier, significantly improving XGBoost's classification performance.