Enhancing facial action unit recognition through topological feature integration and relational learning
摘要
Facial action unit (AU) recognition involves predicting the activation states of AUs, which describe facial movements. In complex scenarios, AU relationships and facial features are challenging to capture effectively. This study proposes a novel AU recognition approach that supplements topological features with AU relationship learning. By integrating a channel-topology convolution feature generation structure (CCFG) with a multi-scale attention feature generation structure (MAFG) within a graph neural network, our method models dynamic AU associations and enriches feature representations. Experimental results demonstrate that our approach significantly outperforms state-of-the-art methods on benchmark datasets, achieving average F1 scores of 66.6% and 67.2% on DISFA and EmotioNet, respectively, highlighting its robustness and precision in facial expression recognition tasks. Our code and dataset documentation are available at https://github.com/lkq52110/au-recognition.