Anomaly Detection in Traffic Surveillance Videos Using Deep Learning

Abstract

In the recent past, a huge number of cameras have been placed in a variety of public and private areas for the purposes of surveillance, the monitoring of abnormal human actions, and traffic surveillance. The detection and recognition of abnormal activity in a real-world environment is a big challenge, as there can be many types of alarming and abnormal activities, such as theft, violence, and accidents. This research deals with accidents in traffic videos. In the modern world, video traffic surveillance cameras (VTSS) are used for traffic surveillance and monitoring. As the population is increasing drastically, the likelihood of accidents is also increasing. The VTSS is used to detect abnormal events or incidents regarding traffic on different roads and highways, such as traffic jams, traffic congestion, and vehicle accidents. Mostly in accidents, people are helpless and some die due to the unavailability of emergency treatment on long highways and those places that are far from cities. This research proposes a methodology for detecting accidents automatically through surveillance videos. A review of the literature suggests that convolutional neural networks (CNNs), which are a specialized deep learning approach pioneered to work with grid-like data, are effective in image and video analysis. This research uses CNNs to find anomalies (accidents) from videos captured by the VTSS and implement a rolling prediction algorithm to achieve high accuracy. In the training of the CNN model, a vehicle accident image dataset (VAID), composed of images with anomalies, was constructed and used. For testing the proposed methodology, the trained CNN model was checked on multiple videos, and the results were collected and analyzed. The results of this research show the successful detection of traffic accident events with an accuracy of 82% in the traffic surveillance system videos.

Surveillance detection of anomalous activities with optimized deep learning technique in crowded scenes

“…𝑋×𝑌 𝑖∈𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒𝑐𝑙𝑎𝑠𝑠 (15) where the number of positive instances is represented as 𝑋 and the number of negative instances is 𝑌. The performance of the model is further validated using the technique of cross-validation, which requires splitting the training, validation, and testing data into 70%, 15%, and 15%, respectively [24], [25].…”

Automated Road Defect and Anomaly Detection for Traffic Safety: A Systematic Review

“…In detecting on-road anomalies, unsupervised learning models hold potential advantages as they do not rely on labelled data for sample classification, unlike supervised learning models, which depend on subjective human input [ 93 , 94 ]. As a result, the output of unsupervised learning models is not predetermined, allowing computers to independently discern anomalies in the data through classification processes [ 95 ]. Ishtiak et al [ 43 ] proposed a system for identifying and categorising various road conditions, including visco-plastic deformities and defects.…”

Vehicle Instance Segmentation Polygonal Dataset for a Private Surveillance System

“…Vehicle recognition is a widely researched area in the field of computer vision, categorizing itself in different tasks such as vehicle make and model recognition (VMMR), vehicle license plate recognition and vehicle re-identification [ 19 , 20 ]. Each task is performed individually or consecutively.…”