<p>This paper investigates the box-constrained <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\ell _0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation>-regularized sparse optimization problem. We introduce the concept of <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\tau \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>τ</mi> </math></EquationSource> </InlineEquation>-stationary point and establish its connection to the local and global minimizers of the box-constrained <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(\ell _0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation>-regularized sparse optimization problem. We utilize the <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(\tau \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>τ</mi> </math></EquationSource> </InlineEquation>-stationary points to define the support set, which we divide into active and inactive components. Subsequently, Newton’s method is employed to update the inactive variables, while the proximal gradient method is utilized to update the active variables. If Newton’s method fails, we use the proximal gradient method to update all variables. Under some mild conditions, we prove the global convergence and the local quadratic convergence rate. Finally, experimental results demonstrate the efficiency of our method.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Subspace Newton’s Method for \(\ell _0\)-Regularized Optimization Problems with Box Constraints

  • Yuge Ye,
  • Qingna Li

摘要

This paper investigates the box-constrained \(\ell _0\) 0 -regularized sparse optimization problem. We introduce the concept of \(\tau \) τ -stationary point and establish its connection to the local and global minimizers of the box-constrained \(\ell _0\) 0 -regularized sparse optimization problem. We utilize the \(\tau \) τ -stationary points to define the support set, which we divide into active and inactive components. Subsequently, Newton’s method is employed to update the inactive variables, while the proximal gradient method is utilized to update the active variables. If Newton’s method fails, we use the proximal gradient method to update all variables. Under some mild conditions, we prove the global convergence and the local quadratic convergence rate. Finally, experimental results demonstrate the efficiency of our method.