<p>We propose a novel Riemannian simulated annealing-based Barzilai–Borwein (RSABB) gradient method for optimization on manifolds. This hybrid approach combines the Barzilai–Borwein (BB) gradient method with a simulated annealing (SA) rule, tailored for optimization problems on the Stiefel manifold. The BB step size we utilize possesses a two-dimensional quadratic termination property. The proposed RSABB gradient method accepts the BB step according to SA rule, resulting in a new nonmonotone line search technique. If the BB step is not accepted, an Armijo line search is employed instead. Under some mild assumptions, we prove the global convergence of the algorithm on general manifolds and further establish the convergence rate and the iteration complexity bound of the algorithm. Experimental results indicate that, the proposed algorithm is highly competitive in terms of computational performance on specific problems and outperforms several existing algorithms.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Riemannian Simulated Annealing-Based Barzilai–Borwein Gradient Method for Manifold Optimization

  • Xue-Jie Wang,
  • Zheng Peng,
  • Xiao-Jiao Tong

摘要

We propose a novel Riemannian simulated annealing-based Barzilai–Borwein (RSABB) gradient method for optimization on manifolds. This hybrid approach combines the Barzilai–Borwein (BB) gradient method with a simulated annealing (SA) rule, tailored for optimization problems on the Stiefel manifold. The BB step size we utilize possesses a two-dimensional quadratic termination property. The proposed RSABB gradient method accepts the BB step according to SA rule, resulting in a new nonmonotone line search technique. If the BB step is not accepted, an Armijo line search is employed instead. Under some mild assumptions, we prove the global convergence of the algorithm on general manifolds and further establish the convergence rate and the iteration complexity bound of the algorithm. Experimental results indicate that, the proposed algorithm is highly competitive in terms of computational performance on specific problems and outperforms several existing algorithms.