Human Action Recognition (HAR) is a significant area of research in video processing that has gained widespread attention due to its various application domains. Since a single human action occurs in several video frames, spatial-temporal features are the key to HAR. This paper presents a hybrid model for recognizing human actions by capturing spatial and temporal features. The proposed model utilizes a residual deep Convolutional Neural Network (CNN) to collect discriminative spatial information from videos. Then average pooling is applied to downsample the spatial dimension of the feature maps and focus on the most informative features. The squeeze and excitation mechanisms are integrated with the proposed model to highlight important action features. These crucial spatial features are then fed to the Gated Recurrent Unit (GRU) to capture temporal dynamics and the sequential dependencies inherent in human actions over time. Finally, a softmax layer is applied for classifying human actions based on the learned spatio-temporal dynamics. The performance of the presented technique was evaluated on the UCF Sports Action and UT-Interaction datasets and achieved an accuracy of 98.89% and 99.28%, respectively. The experimental findings demonstrate the competitive effectiveness of the presented technique compared to cutting-edge techniques.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Attention-Based Efficient CNN-GRU Architecture for Human Action Recognition

  • Ajeet Pandey,
  • Shrey Kashyap,
  • Aman kumar,
  • Kumar Nishant,
  • Piyush Kumar

摘要

Human Action Recognition (HAR) is a significant area of research in video processing that has gained widespread attention due to its various application domains. Since a single human action occurs in several video frames, spatial-temporal features are the key to HAR. This paper presents a hybrid model for recognizing human actions by capturing spatial and temporal features. The proposed model utilizes a residual deep Convolutional Neural Network (CNN) to collect discriminative spatial information from videos. Then average pooling is applied to downsample the spatial dimension of the feature maps and focus on the most informative features. The squeeze and excitation mechanisms are integrated with the proposed model to highlight important action features. These crucial spatial features are then fed to the Gated Recurrent Unit (GRU) to capture temporal dynamics and the sequential dependencies inherent in human actions over time. Finally, a softmax layer is applied for classifying human actions based on the learned spatio-temporal dynamics. The performance of the presented technique was evaluated on the UCF Sports Action and UT-Interaction datasets and achieved an accuracy of 98.89% and 99.28%, respectively. The experimental findings demonstrate the competitive effectiveness of the presented technique compared to cutting-edge techniques.