<p>This paper focuses on the augmented Lagrangian method for solving minimax optimization problems with inequality constraints. The rate of convergence of the augmented Lagrange method is analyzed under a set of sufficiency optimality conditions for the minimax problem. For a given multiplier vector <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\((\mu ,\lambda )\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">(</mo> <mi>μ</mi> <mo>,</mo> <mi>λ</mi> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation>, it is demonstrated that the rate of convergence of the augmented Lagrangian method is linear with respect to <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\Vert (\mu ,\lambda )-(\mu ^*,\lambda ^*)\Vert \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mrow> <mo stretchy="false">‖</mo> <mrow> <mo stretchy="false">(</mo> <mi>μ</mi> <mo>,</mo> <mi>λ</mi> <mo stretchy="false">)</mo> </mrow> <mo>-</mo> </mrow> <mrow> <mo stretchy="false">(</mo> <msup> <mi>μ</mi> <mo>∗</mo> </msup> <mo>,</mo> <msup> <mi>λ</mi> <mo>∗</mo> </msup> <mo stretchy="false">)</mo> </mrow> <mrow> <mo stretchy="false">‖</mo> </mrow> </mrow> </math></EquationSource> </InlineEquation> and the ratio constant is proportional to 1/<i>c</i> when the ratio <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\Vert (\mu ,\lambda )-(\mu ^*,\lambda ^*)\Vert /c\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mrow> <mo stretchy="false">‖</mo> <mrow> <mo stretchy="false">(</mo> <mi>μ</mi> <mo>,</mo> <mi>λ</mi> <mo stretchy="false">)</mo> </mrow> <mo>-</mo> </mrow> <mrow> <mo stretchy="false">(</mo> <msup> <mi>μ</mi> <mo>∗</mo> </msup> <mo>,</mo> <msup> <mi>λ</mi> <mo>∗</mo> </msup> <mo stretchy="false">)</mo> </mrow> <mrow> <mo stretchy="false">‖</mo> <mo stretchy="false">/</mo> <mi>c</mi> </mrow> </mrow> </math></EquationSource> </InlineEquation> is small enough, where <i>c</i> is the penalty parameter that exceeds a threshold <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(c_*&gt; 0\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mmultiscripts> <mi>c</mi> <mrow> <mrow /> <mo>∗</mo> </mrow> <mrow /> </mmultiscripts> <mo>&gt;</mo> <mn>0</mn> </mrow> </math></EquationSource> </InlineEquation> and <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\((\mu ^*,\lambda ^*)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">(</mo> <msup> <mi>μ</mi> <mo>∗</mo> </msup> <mo>,</mo> <msup> <mi>λ</mi> <mo>∗</mo> </msup> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> is the multiplier corresponding to a local minimax point. Moreover, by analyzing the second-order derivative of the value function of the inequality constrained minimax optimization problem, we prove that the sequence of multiplier vectors generated by the augmented Lagrangian method has at least <i>Q</i>-linear convergence if the sequence of penalty parameters <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(\{c_k\}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">{</mo> <msub> <mi>c</mi> <mi>k</mi> </msub> <mo stretchy="false">}</mo> </mrow> </math></EquationSource> </InlineEquation> is bounded and the convergence rate is superlinear if <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(\{c_k\}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">{</mo> <msub> <mi>c</mi> <mi>k</mi> </msub> <mo stretchy="false">}</mo> </mrow> </math></EquationSource> </InlineEquation> is increasing to infinity.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Analysis of the Rate of Local Convergence of the Augmented Lagrangian Method for Minimax Optimization Problems with Inequality Constraints

  • Yu-Hong Dai,
  • Li-Wei Zhang

摘要

This paper focuses on the augmented Lagrangian method for solving minimax optimization problems with inequality constraints. The rate of convergence of the augmented Lagrange method is analyzed under a set of sufficiency optimality conditions for the minimax problem. For a given multiplier vector \((\mu ,\lambda )\) ( μ , λ ) , it is demonstrated that the rate of convergence of the augmented Lagrangian method is linear with respect to \(\Vert (\mu ,\lambda )-(\mu ^*,\lambda ^*)\Vert \) ( μ , λ ) - ( μ , λ ) and the ratio constant is proportional to 1/c when the ratio \(\Vert (\mu ,\lambda )-(\mu ^*,\lambda ^*)\Vert /c\) ( μ , λ ) - ( μ , λ ) / c is small enough, where c is the penalty parameter that exceeds a threshold \(c_*> 0\) c > 0 and \((\mu ^*,\lambda ^*)\) ( μ , λ ) is the multiplier corresponding to a local minimax point. Moreover, by analyzing the second-order derivative of the value function of the inequality constrained minimax optimization problem, we prove that the sequence of multiplier vectors generated by the augmented Lagrangian method has at least Q-linear convergence if the sequence of penalty parameters \(\{c_k\}\) { c k } is bounded and the convergence rate is superlinear if \(\{c_k\}\) { c k } is increasing to infinity.