Graph Convolutional Networks (GCNs) have attracted considerable attention in the realm of human action recognition. However, conventional GCNs-based methods typically struggle to construct adjacency matrices that capture diverse semantics, thus leading to performance limitations. To tackle this issue, we propose the Echo Graph as a set of adjacency matrices, which includes both hierarchical and global graphs. Specifically, our hierarchical graph exploits the hierarchical information based on the selected central broadcast nodes, aggregating joints dispersed across considerable physical distances into a unified semantic space. The global graph we construct transcends the limitations imposed by physically defined topological structures, delving into comprehensive information exchange among nodes. Additionally, we propose node activation and hierarchical activation model. These activations aim to prominently highlight crucial nodes and edges for specific samples. Finally, we incorporate Margin ReLU distillation to improve computational efficiency and design a four-stream integration using only the joint and bone data streams from two central broadcast nodes. Based on the aforementioned components, we propose EchoGCN, capable of extracting representative skeleton features. Experimental results on three datasets (NTU-RGB+D 60, NTU-RGB+D 120, and NW-UCLA) demonstrate that our model achieves state-of-the-art performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

EchoGCN: An Echo Graph Convolutional Network for Skeleton-Based Action Recognition

  • Weiwen Qian,
  • Qian Huang,
  • Chang Li,
  • Zhongqi Chen,
  • Yingchi Mao

摘要

Graph Convolutional Networks (GCNs) have attracted considerable attention in the realm of human action recognition. However, conventional GCNs-based methods typically struggle to construct adjacency matrices that capture diverse semantics, thus leading to performance limitations. To tackle this issue, we propose the Echo Graph as a set of adjacency matrices, which includes both hierarchical and global graphs. Specifically, our hierarchical graph exploits the hierarchical information based on the selected central broadcast nodes, aggregating joints dispersed across considerable physical distances into a unified semantic space. The global graph we construct transcends the limitations imposed by physically defined topological structures, delving into comprehensive information exchange among nodes. Additionally, we propose node activation and hierarchical activation model. These activations aim to prominently highlight crucial nodes and edges for specific samples. Finally, we incorporate Margin ReLU distillation to improve computational efficiency and design a four-stream integration using only the joint and bone data streams from two central broadcast nodes. Based on the aforementioned components, we propose EchoGCN, capable of extracting representative skeleton features. Experimental results on three datasets (NTU-RGB+D 60, NTU-RGB+D 120, and NW-UCLA) demonstrate that our model achieves state-of-the-art performance.