<p>This paper has two main objectives. First, we introduce a Jensen-type extension of the <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\phi \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>ϕ</mi> </math></EquationSource> </InlineEquation>-entropy, which naturally generalizes the classical Jensen–Shannon divergence and explores its connections with Bregman divergence. Several theoretical results are established that highlight the interplay between these entropy and divergence measures, particularly in the context of mixture distributions. Second, we propose the g-mean mixture distribution, a general class of statistical models that encompasses many classical mixtures, such as arithmetic, geometric, and <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\((\alpha ,\lambda )\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">(</mo> <mi>α</mi> <mo>,</mo> <mi>λ</mi> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation>-mixtures, as special cases. We show that this class arises as the optimal solution to a family of optimization problems formulated in terms of Bregman divergence. Finally, we apply the Jensen-<InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(\phi \)</EquationSource> <EquationSource Format="MATHML"><math> <mi>ϕ</mi> </math></EquationSource> </InlineEquation>-entropy to two binary models as an alternative to classical estimation methods, demonstrating promising empirical performance and potential for further theoretical investigation.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Jensen-\(\phi \)-entropy, g-mean mixture distributions and optimal information: application to binary models

  • Omid Kharazmi,
  • Elena Castilla

摘要

This paper has two main objectives. First, we introduce a Jensen-type extension of the \(\phi \) ϕ -entropy, which naturally generalizes the classical Jensen–Shannon divergence and explores its connections with Bregman divergence. Several theoretical results are established that highlight the interplay between these entropy and divergence measures, particularly in the context of mixture distributions. Second, we propose the g-mean mixture distribution, a general class of statistical models that encompasses many classical mixtures, such as arithmetic, geometric, and \((\alpha ,\lambda )\) ( α , λ ) -mixtures, as special cases. We show that this class arises as the optimal solution to a family of optimization problems formulated in terms of Bregman divergence. Finally, we apply the Jensen- \(\phi \) ϕ -entropy to two binary models as an alternative to classical estimation methods, demonstrating promising empirical performance and potential for further theoretical investigation.