<p>Digital content infringement has increased, with geometric cropping, photometric filtering, and stochastic noise significantly affecting redistributed media and destroying automated detection systems. Traditional systems achieve limited adversarial robustness because they use limited annotated data and computationally inefficient, high-dimensional, multimodal descriptors for large-scale retrieval. This research utilizes contrastive self-supervised representation learning to increase adversarial resilience and advanced multimodal feature compression to reduce retrieval complexity while retaining embedding discrimination. This research proposes the MoCo-OSGF framework (momentum contrast with orthogonal subspace and global feature learning), an integrated framework for high-fidelity multimodal infringement analysis. The momentum contrast encoder employs contrastive learning on a 65&#xa0;K-negative queue and over 1 million unlabeled multimodal samples to derive adversarially robust and semantically consistent feature representations. Orthogonality-based regularization, subspace alignment, product-quantization-style feature partitioning, and multi-scale aggregation compress features from 2048 to 256D while preserving over 92% of their discriminative ability in the orthogonal subspace multi granularity compression module. Spatial orthogonality divergence, multi-head attention, and saliency-based spatial modeling in the Global Spatial Feature Learning module preserve fine-grained infringement cues even under high adversary distortions. Key findings indicate 18–22% resilience against adversarial changes and 35% large-scale retrieval accuracy improvement. Results show a 27.6% decrease in retrieval delay and a nearly 48.2% decrease in computational overhead. Finally, MoCo-OSGF is scalable and resilient for next-generation multimodal digital content infringement detection.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Momentum contrast learning-based multimodal digital content infringement detection

  • Haibo Wu,
  • Jie Zhao,
  • Feng Zhou,
  • Yan Chen,
  • Yipao Chen,
  • Jiawei Zhang,
  • Xue Chen,
  • Mingxiao Zhang

摘要

Digital content infringement has increased, with geometric cropping, photometric filtering, and stochastic noise significantly affecting redistributed media and destroying automated detection systems. Traditional systems achieve limited adversarial robustness because they use limited annotated data and computationally inefficient, high-dimensional, multimodal descriptors for large-scale retrieval. This research utilizes contrastive self-supervised representation learning to increase adversarial resilience and advanced multimodal feature compression to reduce retrieval complexity while retaining embedding discrimination. This research proposes the MoCo-OSGF framework (momentum contrast with orthogonal subspace and global feature learning), an integrated framework for high-fidelity multimodal infringement analysis. The momentum contrast encoder employs contrastive learning on a 65 K-negative queue and over 1 million unlabeled multimodal samples to derive adversarially robust and semantically consistent feature representations. Orthogonality-based regularization, subspace alignment, product-quantization-style feature partitioning, and multi-scale aggregation compress features from 2048 to 256D while preserving over 92% of their discriminative ability in the orthogonal subspace multi granularity compression module. Spatial orthogonality divergence, multi-head attention, and saliency-based spatial modeling in the Global Spatial Feature Learning module preserve fine-grained infringement cues even under high adversary distortions. Key findings indicate 18–22% resilience against adversarial changes and 35% large-scale retrieval accuracy improvement. Results show a 27.6% decrease in retrieval delay and a nearly 48.2% decrease in computational overhead. Finally, MoCo-OSGF is scalable and resilient for next-generation multimodal digital content infringement detection.