Fusion of LSTM and RNN for Abnormal Activity Detection from CCTV Camera Feeds

Video surveillance is widely utilized in both public and private settings for observation and monitoring purposes, making it a prominent application of computer vision technology. It resulted in less human work put towards oversight. Homes, workplaces, hospitals, malls, parking lots, etc. places can use smart video surveillance systems. Due to its many uses, including identifying criminal behavior, traffic accidents, and unlawful activities, abnormal detection in video surveillance is a well-liked study topic in computer vision. Abnormal activity means any behavior or event that is not considered normal in a particular situation. For example, in CCTV footage, abnormal activity could include unusual or suspicious actions like theft, vandalism, or violence. The definition of abnormal activity can change based on the surveillance system’s context and objectives. In this paper, we conducted a literature survey on abnormal activity detection. We experimented with detecting violence in videos using a convolutional neural network on the Real-Life Violence Situations(RLVS) dataset. Here, we have implemented three model architectures incorporating spatial and temporal features for violence detection. The first model combines MobileNetV2 with an RNN layer, while the second model employs an LSTM layer instead. The third model uses their strengths to represent a fusion of LSTM and RNN.