Multimodal Aspect-Based Sentiment Analysis (MABSA) is an important task. Its goal is to predict the emotional polarity. Existing methods mainly realize the association between aspects and multimodal features through question and answer modeling, but there are still limitations in the dynamics of modal fusion, the accuracy of aspect-modal alignment, and the use of external knowledge. Therefore, this article proposes MACA (Multimodal Aspect-Based Sentiment Analysis with Dynamic Adaptive Gating, Contrastive Alignment, and LLM Augmentation): A unified framework for MABSA. In order to solve the problem of modal difference and aspect evidence mismatch at the sample level, a method combining dynamic adaptive gating (DAG), aspect-modal contrast alignment (ACA) and LLM prior dual path integration is proposed. The MACA model maintains consistent modal preferences. It adaptively allocates text/image/description/prior contributions through learnable gating, and uses contrastive learning to reinforce consistency between aspect and evidence region. The decision-making layer introduces temperature calibration and confidence modulation, amplifying their effects when the prior is reliable and automatically contracting when the prior is uncertain. On Twitter-15/17, MACA outperforms the strong baseline in multiple tasks. Ablation shows that the three modules reinforce each other, significantly improving the accuracy and robustness of the model.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MACA: Multimodal Aspect-Based Sentiment Analysis with Dynamic Adaptive Attention, Contrastive Alignment, and LLM Augmentation

  • Xuelin Xu,
  • Jun Lu

摘要

Multimodal Aspect-Based Sentiment Analysis (MABSA) is an important task. Its goal is to predict the emotional polarity. Existing methods mainly realize the association between aspects and multimodal features through question and answer modeling, but there are still limitations in the dynamics of modal fusion, the accuracy of aspect-modal alignment, and the use of external knowledge. Therefore, this article proposes MACA (Multimodal Aspect-Based Sentiment Analysis with Dynamic Adaptive Gating, Contrastive Alignment, and LLM Augmentation): A unified framework for MABSA. In order to solve the problem of modal difference and aspect evidence mismatch at the sample level, a method combining dynamic adaptive gating (DAG), aspect-modal contrast alignment (ACA) and LLM prior dual path integration is proposed. The MACA model maintains consistent modal preferences. It adaptively allocates text/image/description/prior contributions through learnable gating, and uses contrastive learning to reinforce consistency between aspect and evidence region. The decision-making layer introduces temperature calibration and confidence modulation, amplifying their effects when the prior is reliable and automatically contracting when the prior is uncertain. On Twitter-15/17, MACA outperforms the strong baseline in multiple tasks. Ablation shows that the three modules reinforce each other, significantly improving the accuracy and robustness of the model.