<p>Conjugate gradient (CG) methods, valued for their low memory requirements, and quasi-Newton (QN) methods, known for fast convergence, are crucial for large-scale unconstrained optimization. Aiming to combine the strengths of these approaches, this paper proposes an efficient Accelerated Three-Term CG with Adaptive Regularization (ATTCG-AR) method. This method modifies the framework of the accelerated NATTCG algorithm by introducing a novel adaptive regularization parameter. Formulated via Frobenius norm minimization inspired by the philosophy of memoryless QN methods, this parameter improves the three-term search direction by intelligently adjusting the gradient component. The resulting search direction ensures the sufficient descent property without reliance on the Powell restart strategy. The global convergence of the proposed algorithm is established under standard assumptions using the Wolfe line search conditions. Performance assessments via Dolan-Moré profiles demonstrate the efficiency of the ATTCG-AR method on standard test problems, further validated by its application to salt-and-pepper noise removal in image restoration.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An efficient three-term conjugate gradient method with adaptive regularization and its application in image restoration

  • M. Salimi Khorshidi,
  • N. Bidabadi

摘要

Conjugate gradient (CG) methods, valued for their low memory requirements, and quasi-Newton (QN) methods, known for fast convergence, are crucial for large-scale unconstrained optimization. Aiming to combine the strengths of these approaches, this paper proposes an efficient Accelerated Three-Term CG with Adaptive Regularization (ATTCG-AR) method. This method modifies the framework of the accelerated NATTCG algorithm by introducing a novel adaptive regularization parameter. Formulated via Frobenius norm minimization inspired by the philosophy of memoryless QN methods, this parameter improves the three-term search direction by intelligently adjusting the gradient component. The resulting search direction ensures the sufficient descent property without reliance on the Powell restart strategy. The global convergence of the proposed algorithm is established under standard assumptions using the Wolfe line search conditions. Performance assessments via Dolan-Moré profiles demonstrate the efficiency of the ATTCG-AR method on standard test problems, further validated by its application to salt-and-pepper noise removal in image restoration.