Abstract <p>The research in computer vision and pattern recognition focuses on detecting and classifying human actions in videos. Using standard convolution for spatial feature extraction leads to large parameters, causing issues like lower performance, overfitting, slow training, and poor prediction. For temporal feature extraction, recurrent neural networks (RNN) are used but these face vanishing gradient problem. Another variant of RNN i.e. long short term memory faces problem of high computational cost. To solve these issues, lightweight convolution neural network model is being proposed named as “DIAT-DSCNN-GRU-HARNet”. This model classifies human activities in videos using separable convolution, dilated convolution, and gated recurrent unit, considering parameters, model size, and floating point operations. We conducted in-depth experiments using realistic videos of UCF-ARG-Arial, UCF-ARG-Ground, and HON4D, comparing results with other approaches to demonstrate the effectiveness of our suggested technique.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

DIAT-DSCNN-GRU-HARNet: A Lightweight DCNN for Video Based Classification of Human Activities

  • Ajay Waghumbare,
  • Upasna Singh

摘要

Abstract

The research in computer vision and pattern recognition focuses on detecting and classifying human actions in videos. Using standard convolution for spatial feature extraction leads to large parameters, causing issues like lower performance, overfitting, slow training, and poor prediction. For temporal feature extraction, recurrent neural networks (RNN) are used but these face vanishing gradient problem. Another variant of RNN i.e. long short term memory faces problem of high computational cost. To solve these issues, lightweight convolution neural network model is being proposed named as “DIAT-DSCNN-GRU-HARNet”. This model classifies human activities in videos using separable convolution, dilated convolution, and gated recurrent unit, considering parameters, model size, and floating point operations. We conducted in-depth experiments using realistic videos of UCF-ARG-Arial, UCF-ARG-Ground, and HON4D, comparing results with other approaches to demonstrate the effectiveness of our suggested technique.