Optimal Transport (OT) provides a principled way to impose geometric structure on the latent spaces of deep generative models. By aligning probability distributions through optimal couplings, it enhances interpolation quality and promotes smoother, more organized latent representations. When integrated with generative architectures, OT enables the learning of interpretable and structured spaces for analyzing complex data. In this work, we present a framework that integrates Conditional Variational Autoencoders (CVAEs) with OT for modeling and reconstructing 3D human body shapes. Our model learns a continuous latent space that captures morphological variability in a compact and geometrically structured form. The use of OT encourages smoother interpolations and better organization within the latent space and the enhancing the generative capabilities of the model. The dataset comprises STAR-based parametric models obtained from multiple sessions throughout nutritional treatments. By applying Wasserstein metrics to the latent space, we improve the structure and interpretability of the learned body representations, obtaining a disentangled representation. Code is available at: https://github.com/Tech4DLab/Disentangled-Latent-Space-for-3D-Human-Body-Models-with-CVAE-and-OT .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Learning Disentangled Latent Space for 3D Human Body Models with Conditional Variational Autoencoders and Optimal Transport

  • Mario Jerez-Tallón,
  • Ismael Beviá-Ballesteros,
  • Bernabe Sanchez-Sos,
  • Nahuel Garcia-D’Urso,
  • Jorge Azorín-López,
  • Andrés Fuster-Guilló

摘要

Optimal Transport (OT) provides a principled way to impose geometric structure on the latent spaces of deep generative models. By aligning probability distributions through optimal couplings, it enhances interpolation quality and promotes smoother, more organized latent representations. When integrated with generative architectures, OT enables the learning of interpretable and structured spaces for analyzing complex data. In this work, we present a framework that integrates Conditional Variational Autoencoders (CVAEs) with OT for modeling and reconstructing 3D human body shapes. Our model learns a continuous latent space that captures morphological variability in a compact and geometrically structured form. The use of OT encourages smoother interpolations and better organization within the latent space and the enhancing the generative capabilities of the model. The dataset comprises STAR-based parametric models obtained from multiple sessions throughout nutritional treatments. By applying Wasserstein metrics to the latent space, we improve the structure and interpretability of the learned body representations, obtaining a disentangled representation. Code is available at: https://github.com/Tech4DLab/Disentangled-Latent-Space-for-3D-Human-Body-Models-with-CVAE-and-OT .