Multi-dimensional feature collaborative fusion networks for multimodal fake news detection
摘要
Current multimodal fake news detection methods usually extract and integrate news text and image features for detection, lacking comprehensive data integration. In addition, the large amount of noise generated by multi-source data also brings additional challenges to fake news detection. To address these issues, we propose a novel multi-dimensional feature collaborative fusion network, named MFCF. This model first constructs two branch networks to learn news content knowledge, including image frequency and spatial domain features, text semantics and sentiment features. A cross-modal co-attention fusion module is designed, which effectively eliminates noise in multi-source data through dynamic and context-aware feature fusion strategies, thereby extracting key information for fake news detection. Furthermore, we designed a cross-modal consistency learning branch network based on contrast language-image pre-training to enhance the model’s ability to detect image-text consistency. MFCF outperforms existing technologies on Weibo, Twitter and GossipCop datasets, achieving higher accuracy rates and surpassing the baseline.