Scholarlink

<p>The rapid proliferation of high-fidelity facial synthesis has made automated deepfake detection a core requirement in digital forensics. Existing detectors that rely exclusively on spatial or temporal cues can be sensitive to compression artifacts and variations among manipulation pipelines. This paper introduces DSTF-Net, a dual-domain spatio-temporal and temporal-frequency framework designed to combine complementary evidence from these two domains. DSTF-Net consists of two coordinated branches. The WaveFormer branch applies a three-level 2D Haar wavelet decomposition to face-aligned frames, generating multi-scale frequency representations that expose seams, resampling traces, and texture inconsistencies, and then aggregates these frame-level descriptors using a transformer-based temporal combiner with hybrid statistical pooling. In parallel, the SFormer branch utilizes a Swin-Transformer backbone combined with a temporal encoder to jointly model spatial structure and motion dynamics across sequences of 32 frames, capturing both local appearance distortions and long-range temporal irregularities. The 512-dimensional embeddings from the two branches are fused using an adapted MLP-Mixer that performs token- and channel-wise mixing to learn a compact, discriminative video-level representation. However, cross-dataset evaluation without target-domain fine-tuning reveals a substantial performance decline, with accuracy ranging from 50.41% to 62.21% and AUC ranging from 0.4776 to 0.7613, depending on the training–testing direction and manipulation category. These results indicate that generalization to unseen dataset and compression characteristics remains challenging. Overall, the results demonstrate the effectiveness of integrating spatio-temporal and frequency-domain cues for intra-dataset deepfake detection, while highlighting the need for additional domain-generalization and compression-invariant learning strategies before deployment in unconstrained environments.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A dual-domain spatio-temporal and frequency framework for robust deepfake detection

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年8月2日

查看全文
  • Arman Sajjadi,
  • Sayna Sarvar,
  • Mobin Nekou,
  • Mahdi Fallah,
  • Delaram Mehralizadeh,
  • Mohammad Hossein Jabbarzadeh,
  • Pedram Salehpour

摘要

The rapid proliferation of high-fidelity facial synthesis has made automated deepfake detection a core requirement in digital forensics. Existing detectors that rely exclusively on spatial or temporal cues can be sensitive to compression artifacts and variations among manipulation pipelines. This paper introduces DSTF-Net, a dual-domain spatio-temporal and temporal-frequency framework designed to combine complementary evidence from these two domains. DSTF-Net consists of two coordinated branches. The WaveFormer branch applies a three-level 2D Haar wavelet decomposition to face-aligned frames, generating multi-scale frequency representations that expose seams, resampling traces, and texture inconsistencies, and then aggregates these frame-level descriptors using a transformer-based temporal combiner with hybrid statistical pooling. In parallel, the SFormer branch utilizes a Swin-Transformer backbone combined with a temporal encoder to jointly model spatial structure and motion dynamics across sequences of 32 frames, capturing both local appearance distortions and long-range temporal irregularities. The 512-dimensional embeddings from the two branches are fused using an adapted MLP-Mixer that performs token- and channel-wise mixing to learn a compact, discriminative video-level representation. However, cross-dataset evaluation without target-domain fine-tuning reveals a substantial performance decline, with accuracy ranging from 50.41% to 62.21% and AUC ranging from 0.4776 to 0.7613, depending on the training–testing direction and manipulation category. These results indicate that generalization to unseen dataset and compression characteristics remains challenging. Overall, the results demonstrate the effectiveness of integrating spatio-temporal and frequency-domain cues for intra-dataset deepfake detection, while highlighting the need for additional domain-generalization and compression-invariant learning strategies before deployment in unconstrained environments.