Flow Matching (FM) is a recent generative modelling technique: we aim to learn how to sample from distribution \(\mathfrak {X}_1\) by flowing samples from some distribution \(\mathfrak {X}_0\) that is easy to sample from. The key trick is that this flow field can be trained while conditioning on the end point in \(\mathfrak {X}_1\) : given an end point, simply move along a straight line segment to the end point [6]. However, straight line segments are only well-defined on Euclidean space. Consequently, [3] generalised the method to FM on Riemannian manifolds, replacing line segments with geodesics or their spectral approximations. We take an alternative point of view: we generalise to FM on Lie groups with surjective exponential maps by instead substituting exponential curves for line segments. This leads to a simple, intrinsic, and fast implementation for many matrix Lie groups, since the required Lie group operations (products, inverses, exponentials, logarithms) are simply given by the corresponding matrix operations. FM on Lie groups could then be used for generative modelling with data consisting of sets of features (in \(\mathbb {R}^n\) ) and poses (in some Lie group), e.g. the latent codes of Equivariant Neural Fields [10].

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Flow Matching on Lie Groups

  • Finn M. Sherry,
  • Bart M. N. Smets

摘要

Flow Matching (FM) is a recent generative modelling technique: we aim to learn how to sample from distribution \(\mathfrak {X}_1\) by flowing samples from some distribution \(\mathfrak {X}_0\) that is easy to sample from. The key trick is that this flow field can be trained while conditioning on the end point in \(\mathfrak {X}_1\) : given an end point, simply move along a straight line segment to the end point [6]. However, straight line segments are only well-defined on Euclidean space. Consequently, [3] generalised the method to FM on Riemannian manifolds, replacing line segments with geodesics or their spectral approximations. We take an alternative point of view: we generalise to FM on Lie groups with surjective exponential maps by instead substituting exponential curves for line segments. This leads to a simple, intrinsic, and fast implementation for many matrix Lie groups, since the required Lie group operations (products, inverses, exponentials, logarithms) are simply given by the corresponding matrix operations. FM on Lie groups could then be used for generative modelling with data consisting of sets of features (in \(\mathbb {R}^n\) ) and poses (in some Lie group), e.g. the latent codes of Equivariant Neural Fields [10].