3D face reconstruction is a versatile technology applied in various contexts. Deep learning methods, in particular, prove highly valuable in this domain due to their ability to generate high-quality 3D models. Nevertheless, most of these techniques require unobstructed and clear facial images as input. In response, we’ve developed a 3D face reconstruction system capable of performing effectively even when faced with obstructed views. Taking inspiration from generative face image inpainting, we’ve introduced a comprehensive method for crafting facial representations guided by their outlines. Our network comprises two components: one dedicated to image enhancement by removing obstructions and restoring missing facial features, while the other utilizes weak supervision to craft exceptionally detailed 3D models. Through extensive experimentation on standard 3D face reconstruction tasks, we’ve demonstrated the superiority of our method compared to existing ones that often fall short. Our results, based on experiments conducted with LFW databases, affirm the effectiveness of our approach.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Learning Contour-Guided 3D Face Reconstruction with Occlusions

  • Dapeng Zhao,
  • Xiaoran Yan

摘要

3D face reconstruction is a versatile technology applied in various contexts. Deep learning methods, in particular, prove highly valuable in this domain due to their ability to generate high-quality 3D models. Nevertheless, most of these techniques require unobstructed and clear facial images as input. In response, we’ve developed a 3D face reconstruction system capable of performing effectively even when faced with obstructed views. Taking inspiration from generative face image inpainting, we’ve introduced a comprehensive method for crafting facial representations guided by their outlines. Our network comprises two components: one dedicated to image enhancement by removing obstructions and restoring missing facial features, while the other utilizes weak supervision to craft exceptionally detailed 3D models. Through extensive experimentation on standard 3D face reconstruction tasks, we’ve demonstrated the superiority of our method compared to existing ones that often fall short. Our results, based on experiments conducted with LFW databases, affirm the effectiveness of our approach.