<p>Micro-expressions (MEs) are brief, involuntary facial movements that reveal genuine emotions and are valuable in applications such as lie detection and criminal investigation. Recent advances in micro-expression recognition (MER) have leveraged Graph Neural Networks to model facial sequences as spatio-temporal graphs, often enhanced with attention mechanisms to emphasize informative landmarks and critical frames. However, existing attention designs typically derive importance weights via learned transformations of intermediate features, which are not explicitly conditioned on sequence-specific motion cues. To address this issue, we propose the Spatio-Temporal Motion Adaptive Graph Convolutional Network (ST-MAGCN), which computes sample-specific landmark and frame weights from temporal feature differences, enabling motion-aware adaptation during inference. The core intuition is that facial regions and frames with greater motion variation carry more discriminative and complementary information. Moreover, we introduce complete graph convolution to capture long-range dependencies between facial landmarks, further enhancing the detection of fine-grained facial changes. Experiments on CASME II, SAMM, and SMIC demonstrate that our approach consistently outperforms existing methods and achieves notable improvements in MER.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Spatio-temporal motion adaptive graph convolutional network for facial micro-expression recognition

  • Shayhan Ameen Chowdhury,
  • Md Azher Uddin,
  • Young-Koo Lee

摘要

Micro-expressions (MEs) are brief, involuntary facial movements that reveal genuine emotions and are valuable in applications such as lie detection and criminal investigation. Recent advances in micro-expression recognition (MER) have leveraged Graph Neural Networks to model facial sequences as spatio-temporal graphs, often enhanced with attention mechanisms to emphasize informative landmarks and critical frames. However, existing attention designs typically derive importance weights via learned transformations of intermediate features, which are not explicitly conditioned on sequence-specific motion cues. To address this issue, we propose the Spatio-Temporal Motion Adaptive Graph Convolutional Network (ST-MAGCN), which computes sample-specific landmark and frame weights from temporal feature differences, enabling motion-aware adaptation during inference. The core intuition is that facial regions and frames with greater motion variation carry more discriminative and complementary information. Moreover, we introduce complete graph convolution to capture long-range dependencies between facial landmarks, further enhancing the detection of fine-grained facial changes. Experiments on CASME II, SAMM, and SMIC demonstrate that our approach consistently outperforms existing methods and achieves notable improvements in MER.