<p>A primal-dual method for solving convex-concave saddle point problems was initially proposed by Chambolle and Pock, and its convergence was first proved by He and Yuan later. This primal-dual method (“CPHY" for short) reduces to the Arrow–Hurwicz method (as well as the primal-dual hybrid gradient method) when the combination parameter <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10589_2025_671_Article_IEq1.gif" Format="GIF" Height="14" Rendition="HTML" Resolution="72" Type="Linedraw" Width="40" /> </InlineMediaObject> <EquationSource Format="TEX">\(\theta =0\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>θ</mi> <mo>=</mo> <mn>0</mn> </mrow> </math></EquationSource> </InlineEquation>, and to a special case of the proximal point algorithm when <InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10589_2025_671_Article_IEq2.gif" Format="GIF" Height="14" Rendition="HTML" Resolution="72" Type="Linedraw" Width="40" /> </InlineMediaObject> <EquationSource Format="TEX">\(\theta =1\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>θ</mi> <mo>=</mo> <mn>1</mn> </mrow> </math></EquationSource> </InlineEquation>, both of which have been well-studied. However, for <InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10589_2025_671_Article_IEq3.gif" Format="GIF" Height="19" Rendition="HTML" Resolution="72" Type="Linedraw" Width="67" /> </InlineMediaObject> <EquationSource Format="TEX">\(\theta \in (0,1)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>θ</mi> <mo>∈</mo> <mo stretchy="false">(</mo> <mn>0</mn> <mo>,</mo> <mn>1</mn> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation>, some theoretical aspects are not yet well-understood, particularly regarding the convergence behavior without imposing strong assumptions. Additionally, although saddle point problems inherently exhibit symmetry between primal and dual variables, the CPHY does not fully exploit this symmetry, as only one variable is updated using an extrapolated step. In this work, we propose a symmetric version of the CPHY by incorporating both symmetry and extrapolation techniques. The resulting algorithm guarantees convergence for <InlineEquation ID="IEq4"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10589_2025_671_Article_IEq4.gif" Format="GIF" Height="19" Rendition="HTML" Resolution="72" Type="Linedraw" Width="80" /> </InlineMediaObject> <EquationSource Format="TEX">\(\theta \in (-1,1)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>θ</mi> <mo>∈</mo> <mo stretchy="false">(</mo> <mo>-</mo> <mn>1</mn> <mo>,</mo> <mn>1</mn> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> and ensures symmetric updates for both primal and dual variables. Numerical experiments on LASSO, TV image inpainting, and graph cuts demonstrate the algorithm’s improved efficiency.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A symmetric version of the generalized Chambolle-Pock-He-Yuan method for saddle point problems

  • Feng Ma,
  • Si Li,
  • Xiayang Zhang

摘要

A primal-dual method for solving convex-concave saddle point problems was initially proposed by Chambolle and Pock, and its convergence was first proved by He and Yuan later. This primal-dual method (“CPHY" for short) reduces to the Arrow–Hurwicz method (as well as the primal-dual hybrid gradient method) when the combination parameter \(\theta =0\) θ = 0 , and to a special case of the proximal point algorithm when \(\theta =1\) θ = 1 , both of which have been well-studied. However, for \(\theta \in (0,1)\) θ ( 0 , 1 ) , some theoretical aspects are not yet well-understood, particularly regarding the convergence behavior without imposing strong assumptions. Additionally, although saddle point problems inherently exhibit symmetry between primal and dual variables, the CPHY does not fully exploit this symmetry, as only one variable is updated using an extrapolated step. In this work, we propose a symmetric version of the CPHY by incorporating both symmetry and extrapolation techniques. The resulting algorithm guarantees convergence for \(\theta \in (-1,1)\) θ ( - 1 , 1 ) and ensures symmetric updates for both primal and dual variables. Numerical experiments on LASSO, TV image inpainting, and graph cuts demonstrate the algorithm’s improved efficiency.