<p>Log-sum-exp function (LSE) is of great interest in optimization, machine learning and statistics. In this note, we establish a general inequality which holds true in a general Hilbert space, and use it to show that the smallest modulus of Lipschitz smoothness of log-sum-exp function on <i>n</i>-dimensional Euclidean space is 1/2 instead of 1 when <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(n\ge 2\)</EquationSource> </InlineEquation>. Proofs based on the Gerschgorin circle theorem or Popoviciu’s inequality on variances are also given.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

On the modulus of Lipschitz smoothness of log-sum-exp function

  • Honglin Luo,
  • Xianfu Wang,
  • Matthew Werenski,
  • Xinmin Yang

摘要

Log-sum-exp function (LSE) is of great interest in optimization, machine learning and statistics. In this note, we establish a general inequality which holds true in a general Hilbert space, and use it to show that the smallest modulus of Lipschitz smoothness of log-sum-exp function on n-dimensional Euclidean space is 1/2 instead of 1 when \(n\ge 2\) . Proofs based on the Gerschgorin circle theorem or Popoviciu’s inequality on variances are also given.