<p>The proximal alternating direction method of multipliers (ADMM) is an efficient algorithm for solving the linearly constrained optimization problem. This work studies the second-order convergence for proximal ADMM. By analyzing the Jacobian matrix associated with the proximal ADMM mapping, we show that the proximal ADMM avoids strict saddle points for almost all initial points. Furthermore, combining this result with the existing first-order convergence, we can establish that the proximal ADMM almost always converges to a second-order stationary point. In addition, we provide a numerical example to validate the second-order convergence of the proximal ADMM.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Note on the Second-Order Convergence of Proximal ADMM for Non-Convex Optimization

  • Jingyu Gao,
  • Xiurui Geng

摘要

The proximal alternating direction method of multipliers (ADMM) is an efficient algorithm for solving the linearly constrained optimization problem. This work studies the second-order convergence for proximal ADMM. By analyzing the Jacobian matrix associated with the proximal ADMM mapping, we show that the proximal ADMM avoids strict saddle points for almost all initial points. Furthermore, combining this result with the existing first-order convergence, we can establish that the proximal ADMM almost always converges to a second-order stationary point. In addition, we provide a numerical example to validate the second-order convergence of the proximal ADMM.