Designing Lightweight Multimodal Models for Real-Time Fake News Classification
摘要
In the digital era, misinformation has significantly threatened public stability and collective reasoning. While multimodal misinformation detection systems have demonstrated effectiveness, their real-time applicability remains constrained due to heavy computational demands and a lack of interpretability. This paper proposes a novel explainable framework, Multimodal Transfer Learning for Fake News Detection with Explainability (MTLFND-X), which integrates attention-based multimodal fusion with visual and textual explanation modules. The model uses RoBERTa and ResNet50 for efficient text and image representation, respectively, with an attention mechanism for adaptive fusion. Additionally, explainability is embedded via Grad-CAM for images, TimeSformer for Video and token-level attention maps for text, enabling human-understandable insights into model predictions. Evaluation across benchmark datasets such as Gossipcop, Weibo, Fakeddit, and Politifact shows competitive accuracy, precision, recall, and F1-score. This model combines robustness, real-time feasibility, and interpretability, making it suitable for deployment in high-stakes environments like media monitoring and misinformation alert systems.