Self and cross-modal attention based features fusion for fake news detection
摘要
Detecting fake news has gained significant attention as misinformation spreads rapidly across social media, often supported by misleading images and texts. Prior methods mainly rely on independent concatenation of unimodal features, which fails to capture the benefits of integrated multimodal information and often lacks specialized mechanisms for feature extraction and fusion. To tackle these issues, this paper proposes an end-to-end multimodal framework that leverages BERT for textual features, ResNeXt for visual features, and BLIP and CLIP for multimodal feature extraction. A key novelty of the work lies in the use of self- and cross-attention–based fusion, which ensures deeper integration of modalities, yielding richer and more discriminative representations compared to simple concatenation. The proposed model is evaluated on Weibo, Gossipcop, and Fakeddit datasets. Results show competitive performance on Weibo and Gossipcop while achieving a notable improvement of