A multi-label classification method combined with texture enhancement for deepfake face detection
摘要
As deepfake technology continues to evolve, existing techniques can manipulate specific regions such as facial components, and the small forgery area makes forgery more difficult to detect. Therefore, deepfake detection technology cannot be limited to real and fake face detection methods based on binary classification. To enable fine-grained detection of facial component forgeries, we propose a detection approach leveraging multi-label classification to simultaneously identify deepfake labels across various facial components. We first process the facial components manipulation dataset using a data augmentation method with information deletion to enrich the dataset with more varied samples. The texture feature enhancement module is also used to enhance the forged traces in the shallow features and enhance the network’s capability in identifying manipulation artifacts. We then apply Asymmetric Polynomial Loss (APL) to address the issue of label imbalance within the dataset. Experimental evaluation demonstrates that our method reaches a mAP of 92.08