<p>Whether the BFGS method is globally convergent under weak Wolfe-Powell (WWP) line search is a question of wide interest in recent years. For convex functions, the BFGS method is easily proved to have global convergence, but for nonconvex functions in general, the BFGS method does not have global convergence. Therefore, we propose an improved BFGS algorithm with global convergence, which has the following properties: (i) the iterative direction is modified so that the modified direction satisfies the special descent condition; (ii) the assumption for proving global convergence are weakened and the proof procedure is given in detail; the improved BFGS algorithm is globally convergent for general functions, and it has a wider application range. Meanwhile, numerical experiments also show that our algorithm has good performance.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Modified BFGS algorithm with particular descent condition for nonconvex functions

  • Xiangli Li,
  • Binglan Li,
  • Zhiling Wang

摘要

Whether the BFGS method is globally convergent under weak Wolfe-Powell (WWP) line search is a question of wide interest in recent years. For convex functions, the BFGS method is easily proved to have global convergence, but for nonconvex functions in general, the BFGS method does not have global convergence. Therefore, we propose an improved BFGS algorithm with global convergence, which has the following properties: (i) the iterative direction is modified so that the modified direction satisfies the special descent condition; (ii) the assumption for proving global convergence are weakened and the proof procedure is given in detail; the improved BFGS algorithm is globally convergent for general functions, and it has a wider application range. Meanwhile, numerical experiments also show that our algorithm has good performance.