<p>We study the convergence rate of Sinkhorn’s algorithm for solving entropy-regularized optimal transport problems when at least one of the probability measures, <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\mu \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>μ</mi> </math></EquationSource> </InlineEquation>, admits a density over <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(\mathbb {R}^d\)</EquationSource> <EquationSource Format="MATHML"><math> <msup> <mrow> <mi mathvariant="double-struck">R</mi> </mrow> <mi>d</mi> </msup> </math></EquationSource> </InlineEquation>. For a semi-concave cost function bounded by <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(c_{\infty }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>c</mi> <mi>∞</mi> </msub> </math></EquationSource> </InlineEquation> and a regularization parameter <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\lambda &gt; 0\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>λ</mi> <mo>&gt;</mo> <mn>0</mn> </mrow> </math></EquationSource> </InlineEquation>, we obtain exponential convergence guarantees on the dual sub-optimality gap with contraction rates that are polynomial in <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(\lambda /c_{\infty }\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>λ</mi> <mo stretchy="false">/</mo> <msub> <mi>c</mi> <mi>∞</mi> </msub> </mrow> </math></EquationSource> </InlineEquation>. This represents an exponential improvement over the known contraction rate <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(1 - \Theta (\exp (-c_{\infty }/\lambda ))\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>1</mn> <mo>-</mo> <mi mathvariant="normal">Θ</mi> <mo stretchy="false">(</mo> <mo>exp</mo> <mrow> <mo stretchy="false">(</mo> <mo>-</mo> <msub> <mi>c</mi> <mi>∞</mi> </msub> <mo stretchy="false">/</mo> <mi>λ</mi> <mo stretchy="false">)</mo> </mrow> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> achievable via Hilbert’s projective metric. Specifically, we prove a contraction rate value of <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(1-\Theta (\lambda ^2/c_\infty ^2)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>1</mn> <mo>-</mo> <mi mathvariant="normal">Θ</mi> <mo stretchy="false">(</mo> <msup> <mi>λ</mi> <mn>2</mn> </msup> <mo stretchy="false">/</mo> <msubsup> <mi>c</mi> <mi>∞</mi> <mn>2</mn> </msubsup> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> when <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(\mu \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>μ</mi> </math></EquationSource> </InlineEquation> has a bounded log-density. In some cases, such as when <InlineEquation ID="IEq9"> <EquationSource Format="TEX">\(\mu \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>μ</mi> </math></EquationSource> </InlineEquation> is log-concave and the cost function is <InlineEquation ID="IEq10"> <EquationSource Format="TEX">\(c(x,y)=-\langle x, y\rangle \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>c</mi> <mo stretchy="false">(</mo> <mi>x</mi> <mo>,</mo> <mi>y</mi> <mo stretchy="false">)</mo> <mo>=</mo> <mo>-</mo> <mo stretchy="false">⟨</mo> <mi>x</mi> <mo>,</mo> <mi>y</mi> <mo stretchy="false">⟩</mo> </mrow> </math></EquationSource> </InlineEquation>, this rate improves to <InlineEquation ID="IEq11"> <EquationSource Format="TEX">\(1-\Theta (\lambda /c_\infty )\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>1</mn> <mo>-</mo> <mi mathvariant="normal">Θ</mi> <mo stretchy="false">(</mo> <mi>λ</mi> <mo stretchy="false">/</mo> <msub> <mi>c</mi> <mi>∞</mi> </msub> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation>. The latter rate matches the one that we derive for the transport between isotropic Gaussian measures, indicating tightness in the dependency in <InlineEquation ID="IEq12"> <EquationSource Format="TEX">\(\lambda /c_\infty \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>λ</mi> <mo stretchy="false">/</mo> <msub> <mi>c</mi> <mi>∞</mi> </msub> </mrow> </math></EquationSource> </InlineEquation>. Our results are fully non-asymptotic and explicit in all the parameters of the problem.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Sharper exponential convergence rates for Sinkhorn’s algorithm in continuous settings

  • Lénaïc Chizat,
  • Alex Delalande,
  • Tomas Vaškevičius

摘要

We study the convergence rate of Sinkhorn’s algorithm for solving entropy-regularized optimal transport problems when at least one of the probability measures, \(\mu \) μ , admits a density over \(\mathbb {R}^d\) R d . For a semi-concave cost function bounded by \(c_{\infty }\) c and a regularization parameter \(\lambda > 0\) λ > 0 , we obtain exponential convergence guarantees on the dual sub-optimality gap with contraction rates that are polynomial in \(\lambda /c_{\infty }\) λ / c . This represents an exponential improvement over the known contraction rate \(1 - \Theta (\exp (-c_{\infty }/\lambda ))\) 1 - Θ ( exp ( - c / λ ) ) achievable via Hilbert’s projective metric. Specifically, we prove a contraction rate value of \(1-\Theta (\lambda ^2/c_\infty ^2)\) 1 - Θ ( λ 2 / c 2 ) when \(\mu \) μ has a bounded log-density. In some cases, such as when \(\mu \) μ is log-concave and the cost function is \(c(x,y)=-\langle x, y\rangle \) c ( x , y ) = - x , y , this rate improves to \(1-\Theta (\lambda /c_\infty )\) 1 - Θ ( λ / c ) . The latter rate matches the one that we derive for the transport between isotropic Gaussian measures, indicating tightness in the dependency in \(\lambda /c_\infty \) λ / c . Our results are fully non-asymptotic and explicit in all the parameters of the problem.