Rumor propagators are growingly employing diverse media formats to attract and deceive social media audiences. In recent years, the multimedia rumor detection model has made comprehensive use of text, visual, and social structure features for classification but does not make full use of and fusion of these features. In this paper, we put forward a Dynamic Association Hypergraph Attention Enhanced Multimodal Feature Fusion Network for rumor detection. DAHAE-MFFN enhances the representation of different patterns in a unified framework before effectively combining text, visual, and social graph features to complete the task of rumor detection. Specifically, DAHAE-MFFN introduces the Feature Information Enhancement (FIE) module, which not only enhances text and visual features by adaptively capturing the correlation between patterns but also learns complex relationships in social graphs through a dynamic association hypergraph attention network. In addition, DAHAE-MFFN introduces the Multimodal Interactive Fusion Network (MIFN) to integrate multi-modal features, which not only captures cross-modal interactions but also considers the weight allocation of different patterns at the feature level. Extensive experiments on two open datasets indicate that the algorithm surpass the existing methods in rumor detection.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

DAHAE-MFFN: Dynamic Association Hypergraph Attention Enhanced Multimodal Feature Fusion Network

  • Xinyu Zheng,
  • Yicun Liu,
  • Xianguo Zhang

摘要

Rumor propagators are growingly employing diverse media formats to attract and deceive social media audiences. In recent years, the multimedia rumor detection model has made comprehensive use of text, visual, and social structure features for classification but does not make full use of and fusion of these features. In this paper, we put forward a Dynamic Association Hypergraph Attention Enhanced Multimodal Feature Fusion Network for rumor detection. DAHAE-MFFN enhances the representation of different patterns in a unified framework before effectively combining text, visual, and social graph features to complete the task of rumor detection. Specifically, DAHAE-MFFN introduces the Feature Information Enhancement (FIE) module, which not only enhances text and visual features by adaptively capturing the correlation between patterns but also learns complex relationships in social graphs through a dynamic association hypergraph attention network. In addition, DAHAE-MFFN introduces the Multimodal Interactive Fusion Network (MIFN) to integrate multi-modal features, which not only captures cross-modal interactions but also considers the weight allocation of different patterns at the feature level. Extensive experiments on two open datasets indicate that the algorithm surpass the existing methods in rumor detection.