LUCID: lexicon-augmented fusion with ordinal calibration for multimodal sentiment analysis
摘要
Multimodal Sentiment Analysis (MSA) still faces three major challenges in existing research: insufficient utilization of lexical-level sentiment knowledge, lack of flexibility in cross-modal fusion, and inconsistency between prediction targets and evaluation metrics. These issues limit the generalization ability of models in complex scenarios. To address these problems, this paper proposes LUCID, a unified framework that integrates Lexicon-aware Multi-tag Embedding (LME), Layer-Selective Cross-modal Fusion (LSCF), and Distributional Ordinal Regression with Correlation and Sign-Consistency Margin (DORC-SCM). The framework strengthens textual representations with lexicon priors, dynamically injects visual and acoustic features across layers, and jointly optimizes ordinal regression with correlation and sign-consistency constraints, thereby achieving robust multimodal modeling. Experiments on CMU-MOSI, CMU-MOSEI, and the Chinese dataset CH-SIMS demonstrate that LUCID outperforms most existing methods on key metrics such as ACC2, ACC7, MAE, and Corr. Further ablation studies and visualization analyses confirm the independent contributions and synergistic effects of each module, indicating that the framework achieves higher consistency and stability in cross-lingual multimodal sentiment analysis and shows broad application potential.