<p>Video violence detection poses significant challenges due to the complex integration of spatial, temporal, and contextual features. Conventional methods, such as 3D Convolutional Neural Networks, Long Short-Term Memory Models, and You Only Look Once, exhibit limited scene-level semantic understanding, high computational costs, and poor generalization across diverse environments. This work proposes a novel hybrid context-aware framework that combines a lightweight MobileNetV2 with a Bidirectional Long Short-Term Memory (BiLSTM) network for efficient spatiotemporal feature extraction. YOLOv8 is used for real-time object detection and Bootstrapping Language-Image Pre-training is utilized for generating the natural language captions to enhance high-level semantic understanding of scenes. The violence detection module is trained on the Real-Life Violence Situations (RLVS) dataset, achieving classification accuracy of 92.49%.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A hybrid context-aware video violence detection framework using hierarchical spatiotemporal and semantic modeling

  • Shobha Kumari,
  • Vijay Kumar

摘要

Video violence detection poses significant challenges due to the complex integration of spatial, temporal, and contextual features. Conventional methods, such as 3D Convolutional Neural Networks, Long Short-Term Memory Models, and You Only Look Once, exhibit limited scene-level semantic understanding, high computational costs, and poor generalization across diverse environments. This work proposes a novel hybrid context-aware framework that combines a lightweight MobileNetV2 with a Bidirectional Long Short-Term Memory (BiLSTM) network for efficient spatiotemporal feature extraction. YOLOv8 is used for real-time object detection and Bootstrapping Language-Image Pre-training is utilized for generating the natural language captions to enhance high-level semantic understanding of scenes. The violence detection module is trained on the Real-Life Violence Situations (RLVS) dataset, achieving classification accuracy of 92.49%.