The rapid growth of short video platforms has accelerated the dissemination of fake news in the form of videos. Compared to traditional fake news, short video fake news integrates multi-modal information such as text, audio, and video. However, existing fake news detection methods face significant challenges in processing long-sequence data like videos and uncovering the inherent relationships between diverse modalities. To address the above problems, we propose a short video fake news detection based on MambaFormer method called SVFDMF. Specifically, SVFDMF alternates between mamba layers, multi-head attention mechanisms, and adaptive normalization layers to effectively extract long-sequence features from modalities such as video and audio while preserving temporal structural information. In addition, we design a Transformer-based cross-modal fusion mechanism to capture more complex inter-modal correlations. Extensive experimental results demonstrate that our proposed method outperforms existing methods. The code is available at https://github.com/SVFDMF-main/SVFDMF .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Cross-Modal Fusion Method for Short Video Fake News Detection via MambaFormer

  • Chunyu Zhang,
  • Liyuan Zhang,
  • Jiachen Ma,
  • Wei Zhang,
  • Yong Liu

摘要

The rapid growth of short video platforms has accelerated the dissemination of fake news in the form of videos. Compared to traditional fake news, short video fake news integrates multi-modal information such as text, audio, and video. However, existing fake news detection methods face significant challenges in processing long-sequence data like videos and uncovering the inherent relationships between diverse modalities. To address the above problems, we propose a short video fake news detection based on MambaFormer method called SVFDMF. Specifically, SVFDMF alternates between mamba layers, multi-head attention mechanisms, and adaptive normalization layers to effectively extract long-sequence features from modalities such as video and audio while preserving temporal structural information. In addition, we design a Transformer-based cross-modal fusion mechanism to capture more complex inter-modal correlations. Extensive experimental results demonstrate that our proposed method outperforms existing methods. The code is available at https://github.com/SVFDMF-main/SVFDMF .