Advancements in deep learning have stimulated the creation of multiple techniques for facial expression translation. However, these methods frequently rely on detailed annotations of action units (AU) or 3D modelling techniques. In this paper, we introduce a novel Contrast-enhanced Guided Facial Expression Translation (CeFET) method. The model uses only facial images as input and extracts facial features from these images using an encoder model based on the StyleGAN prior. We propose a contrast-enhanced guidance technique aimed at minimizing the distance between the generated face and the input face, as well as the distance between the generated expression and the reference expression. This ensures that the generated face maintains identity consistency with the source face and expression consistency with the reference face. Extensive experimental results support the effectiveness of our method.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

CeFET: Contrast-Enhanced Guided Facial Expression Translation

  • Linfeng Han,
  • Zhong Jin,
  • Yi-Chang Li,
  • Zhiyang Jia

摘要

Advancements in deep learning have stimulated the creation of multiple techniques for facial expression translation. However, these methods frequently rely on detailed annotations of action units (AU) or 3D modelling techniques. In this paper, we introduce a novel Contrast-enhanced Guided Facial Expression Translation (CeFET) method. The model uses only facial images as input and extracts facial features from these images using an encoder model based on the StyleGAN prior. We propose a contrast-enhanced guidance technique aimed at minimizing the distance between the generated face and the input face, as well as the distance between the generated expression and the reference expression. This ensures that the generated face maintains identity consistency with the source face and expression consistency with the reference face. Extensive experimental results support the effectiveness of our method.