<p>Occlusion plays a critical role in accurate image analysis and feature identification in face recognition. Occlusions caused by random objects on an image can make it challenging to match the occluded image with the registered image in a database. To the best of the authors' knowledge, all well-known methods have focused on the problem of single occlusion in biometrics. To address the issue of multi-level occlusion, a novel feature-oriented GAN-based multi-occlusion removal framework (GMORF) is proposed. It consists of four components: face alignment using a spatial transformer network, a binary map generation with QUnet++, multi-occlusion removal through pixel-level similarity, and feature-level similarity enforcement using ResNet for improved inpainting. All components are integrated into an end-to-end network, and extensive experiments demonstrate GMORF's effectiveness in biometric verification with occluded faces.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

GMORF: A GAN-Based Multi-occlusion Removal Framework for Biometric Verification

  • Parul Choudhary,
  • Pooja Pathak,
  • Phalguni Gupta

摘要

Occlusion plays a critical role in accurate image analysis and feature identification in face recognition. Occlusions caused by random objects on an image can make it challenging to match the occluded image with the registered image in a database. To the best of the authors' knowledge, all well-known methods have focused on the problem of single occlusion in biometrics. To address the issue of multi-level occlusion, a novel feature-oriented GAN-based multi-occlusion removal framework (GMORF) is proposed. It consists of four components: face alignment using a spatial transformer network, a binary map generation with QUnet++, multi-occlusion removal through pixel-level similarity, and feature-level similarity enforcement using ResNet for improved inpainting. All components are integrated into an end-to-end network, and extensive experiments demonstrate GMORF's effectiveness in biometric verification with occluded faces.