<p>For a class of sparse optimization problems with the penalty function of <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\Vert (\cdot )_+\Vert _0\)</EquationSource> </InlineEquation>, we first characterize its local minimizers and then propose an extrapolated hard thresholding algorithm to solve such problems. We show that the iterates generated by the proposed algorithm with <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\epsilon &gt;0\)</EquationSource> </InlineEquation> (where <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(\epsilon \)</EquationSource> </InlineEquation> is the dry friction coefficient) have finite length, without relying on the Kurdyka-Łojasiewicz inequality. Furthermore, we demonstrate that the algorithm converges to an <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(\epsilon \)</EquationSource> </InlineEquation>-local minimizer of this problem. For the special case that <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(\epsilon =0\)</EquationSource> </InlineEquation>, we establish that any accumulation point of the iterates is a local minimizer of the problem. Additionally, we analyze the convergence when an error term is present in the algorithm, showing that the algorithm still converges in the same manner as before, provided that the errors asymptotically approach zero. Finally, we conduct numerical experiments to verify the theoretical results of the proposed algorithm.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Extrapolated hard thresholding algorithms with finite length for composite \(\ell _0\) penalized problems

  • Fan Wu,
  • Jiazhen Wei,
  • Wei Bian

摘要

For a class of sparse optimization problems with the penalty function of \(\Vert (\cdot )_+\Vert _0\) , we first characterize its local minimizers and then propose an extrapolated hard thresholding algorithm to solve such problems. We show that the iterates generated by the proposed algorithm with \(\epsilon >0\) (where \(\epsilon \) is the dry friction coefficient) have finite length, without relying on the Kurdyka-Łojasiewicz inequality. Furthermore, we demonstrate that the algorithm converges to an \(\epsilon \) -local minimizer of this problem. For the special case that \(\epsilon =0\) , we establish that any accumulation point of the iterates is a local minimizer of the problem. Additionally, we analyze the convergence when an error term is present in the algorithm, showing that the algorithm still converges in the same manner as before, provided that the errors asymptotically approach zero. Finally, we conduct numerical experiments to verify the theoretical results of the proposed algorithm.