<p>In this paper, we propose a restart scheme for FISTA (Fast Iterative Shrinking-Threshold Algorithm) [<CitationRef CitationID="CR6">6</CitationRef>]. This method which is a generalisation of Nesterov’s accelerated gradient algorithm [<CitationRef CitationID="CR23">23</CitationRef>] is widely used in the field of large-scale convex optimization problems as it ensures a quadratic decrease <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="10957_2025_2688_Article_IEq1.gif" Format="GIF" Height="23" Rendition="HTML" Resolution="72" Type="Linedraw" Width="61" /> </InlineMediaObject> <EquationSource Format="TEX">\(o\left( 1/k^2\right) \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>o</mi> <mfenced close=")" open="("> <mn>1</mn> <mo stretchy="false">/</mo> <msup> <mi>k</mi> <mn>2</mn> </msup> </mfenced> </mrow> </math></EquationSource> </InlineEquation> of the error for convex functions [<CitationRef CitationID="CR3">3</CitationRef>, <CitationRef CitationID="CR12">12</CitationRef>]. When considering a function that satisfies stronger assumptions such as strong convexity or quadratic growth, several methods provide faster convergence rates by taking advantage of this geometry property, including FISTA restart schemes. In particular, the schemes that provide the fastest theoretical convergence rates rely on the growth parameter of the function, which is generally difficult to estimate. Recent works [<CitationRef CitationID="CR1">1</CitationRef>, <CitationRef CitationID="CR2">2</CitationRef>] show that restarting FISTA can ensure a fast convergence for functions having a quadratic growth without requiring any knowledge on the growth parameter. We improve these restart schemes by providing a better asymptotical convergence rate and by requiring a lower computational cost. We illustrate our theoretical results with some numerical examples.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

FISTA Restart Using an Automatic Estimation of the Growth Parameter

  • Jean-François Aujol,
  • Charles Dossal,
  • Hippolyte Labarrière,
  • Aude Rondepierre

摘要

In this paper, we propose a restart scheme for FISTA (Fast Iterative Shrinking-Threshold Algorithm) [6]. This method which is a generalisation of Nesterov’s accelerated gradient algorithm [23] is widely used in the field of large-scale convex optimization problems as it ensures a quadratic decrease \(o\left( 1/k^2\right) \) o 1 / k 2 of the error for convex functions [3, 12]. When considering a function that satisfies stronger assumptions such as strong convexity or quadratic growth, several methods provide faster convergence rates by taking advantage of this geometry property, including FISTA restart schemes. In particular, the schemes that provide the fastest theoretical convergence rates rely on the growth parameter of the function, which is generally difficult to estimate. Recent works [1, 2] show that restarting FISTA can ensure a fast convergence for functions having a quadratic growth without requiring any knowledge on the growth parameter. We improve these restart schemes by providing a better asymptotical convergence rate and by requiring a lower computational cost. We illustrate our theoretical results with some numerical examples.