<p>The <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\ell _1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation>-regularized optimization problem has been extensively studied, leading to the development of various numerical algorithms. The active-set proximal-Newton algorithm, introduced in [J. Sci. Comput., 85(3):57, 2020], effectively solves box-constrained <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\ell _1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation> optimization problems by distinguishing between active and free variables and integrating the proximal gradient method with Newton’s method to ensure iterative convergence. In this paper, we prove the superlinear or quadratic local convergence of the active-set proximal-Newton algorithm under a specific strict complementarity-like condition. For problems that do not satisfy this condition, we propose a two-stage active-set proximal-Newton algorithm and establish its superlinear or quadratic local convergence without the need for the strict complementarity-like condition. Numerical results on a set of test problems illustrate that the two-stage algorithm outperforms the original active-set proximal-Newton algorithm.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

On the local convergence of active-set proximal-Newton algorithms for \(\ell _1\)-regularized optimization problems with box constraints

  • Jinji Yang,
  • Chungen Shen,
  • Xiaojing Zhu,
  • Wenjuan Xue

摘要

The \(\ell _1\) 1 -regularized optimization problem has been extensively studied, leading to the development of various numerical algorithms. The active-set proximal-Newton algorithm, introduced in [J. Sci. Comput., 85(3):57, 2020], effectively solves box-constrained \(\ell _1\) 1 optimization problems by distinguishing between active and free variables and integrating the proximal gradient method with Newton’s method to ensure iterative convergence. In this paper, we prove the superlinear or quadratic local convergence of the active-set proximal-Newton algorithm under a specific strict complementarity-like condition. For problems that do not satisfy this condition, we propose a two-stage active-set proximal-Newton algorithm and establish its superlinear or quadratic local convergence without the need for the strict complementarity-like condition. Numerical results on a set of test problems illustrate that the two-stage algorithm outperforms the original active-set proximal-Newton algorithm.