<p>The proximal point algorithm (PPA) stands as a fundamental approach for solving monotone inclusion problems. Notably, several key convex optimization algorithms have been proven to be specific instances of PPA. Given the importance of the PPA, there has been growing interest in developing its accelerated variants. However, some existing accelerated PPAs exhibit oscillatory behavior, which can impede their numerical convergence rate. In this paper, we first introduce an ODE system and demonstrate its <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\( o(1/t^2) \)</EquationSource> </InlineEquation> convergence rate and weak convergence property. Next, we apply the Symplectic Euler Method to discretize the ODE and obtain a new accelerated PPA, which we call the symplectic proximal point algorithm (SPPA). The reason for using the Symplectic Euler Method is its ability to preserve the geometric structure of the ODEs. Theoretically, we demonstrate that the SPPA achieves an <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\( o(1/k^2) \)</EquationSource> </InlineEquation> convergence rate and that the sequences generated by our method converge weakly to the solution set. Practically, our numerical experiments illustrate that the SPPA significantly reduces oscillatory behavior, leading to improved long-time behavior and faster numerical convergence rate.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Symplectic discretization approach for developing new proximal point algorithm

  • Ya-xiang Yuan,
  • Yi Zhang

摘要

The proximal point algorithm (PPA) stands as a fundamental approach for solving monotone inclusion problems. Notably, several key convex optimization algorithms have been proven to be specific instances of PPA. Given the importance of the PPA, there has been growing interest in developing its accelerated variants. However, some existing accelerated PPAs exhibit oscillatory behavior, which can impede their numerical convergence rate. In this paper, we first introduce an ODE system and demonstrate its \( o(1/t^2) \) convergence rate and weak convergence property. Next, we apply the Symplectic Euler Method to discretize the ODE and obtain a new accelerated PPA, which we call the symplectic proximal point algorithm (SPPA). The reason for using the Symplectic Euler Method is its ability to preserve the geometric structure of the ODEs. Theoretically, we demonstrate that the SPPA achieves an \( o(1/k^2) \) convergence rate and that the sequences generated by our method converge weakly to the solution set. Practically, our numerical experiments illustrate that the SPPA significantly reduces oscillatory behavior, leading to improved long-time behavior and faster numerical convergence rate.