<p>We propose a novel deterministic sampling method, EVI-MMD, to approximate a target distribution <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\rho ^*\)</EquationSource> <EquationSource Format="MATHML"><math> <msup> <mi>ρ</mi> <mo>∗</mo> </msup> </math></EquationSource> </InlineEquation> by minimizing the kernel discrepancy, also known as the Maximum Mean Discrepancy (MMD). Leveraging the <i>energetic variational inference</i> framework [<CitationRef CitationID="CR77">77</CitationRef>], we transform the MMD minimization problem into solving a dynamic system of Ordinary Differential Equations (ODEs) for particles. The implicit Euler scheme is employed to solve the ODE system, leading to a proximal minimization problem at each iteration, which is efficiently addressed using optimization algorithms such as L-BFGS. A key innovation of our method is a dynamic bandwidth selection strategy for the Gaussian kernel, which, although heuristic at this stage, represents a meaningful step toward addressing a long-standing challenge in kernel-based methods. Comprehensive numerical experiments demonstrate that this adaptive bandwidth significantly enhances the performance of EVI-MMD. We apply the EVI-MMD algorithm to two types of sampling problems: (1) when the target distribution is fully specified by a density function, and (2) the “two-sample problem,” where only training data are available. In the latter case, EVI-MMD serves as a generative model, producing new samples that faithfully replicate the distribution of the training data. With carefully tuned parameters, EVI-MMD outperforms several existing methods in both scenarios.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Deterministic Sampling Method via Maximum Mean Discrepancy Flow with Adaptive Kernel

  • Yindong Chen,
  • Yiwei Wang,
  • Chun Liu,
  • Lulu Kang

摘要

We propose a novel deterministic sampling method, EVI-MMD, to approximate a target distribution \(\rho ^*\) ρ by minimizing the kernel discrepancy, also known as the Maximum Mean Discrepancy (MMD). Leveraging the energetic variational inference framework [77], we transform the MMD minimization problem into solving a dynamic system of Ordinary Differential Equations (ODEs) for particles. The implicit Euler scheme is employed to solve the ODE system, leading to a proximal minimization problem at each iteration, which is efficiently addressed using optimization algorithms such as L-BFGS. A key innovation of our method is a dynamic bandwidth selection strategy for the Gaussian kernel, which, although heuristic at this stage, represents a meaningful step toward addressing a long-standing challenge in kernel-based methods. Comprehensive numerical experiments demonstrate that this adaptive bandwidth significantly enhances the performance of EVI-MMD. We apply the EVI-MMD algorithm to two types of sampling problems: (1) when the target distribution is fully specified by a density function, and (2) the “two-sample problem,” where only training data are available. In the latter case, EVI-MMD serves as a generative model, producing new samples that faithfully replicate the distribution of the training data. With carefully tuned parameters, EVI-MMD outperforms several existing methods in both scenarios.