Review on Deep Learning Approaches for Anomaly Event Detection in Video Surveillance

Abstract

In the last few years, due to the continuous advancement of technology, human behavior detection and recognition have become important scientific research in the field of computer vision (CV). However, one of the most challenging problems in CV is anomaly detection (AD) because of the complex environment and the difficulty in extracting a particular feature that correlates with a particular event. As the number of cameras monitoring a given area increases, it will become vital to have systems capable of learning from the vast amounts of available data to identify any potential suspicious behavior. Then, the introduction of deep learning (DL) has brought new development directions for AD. In particular, DL models such as convolution neural networks (CNNs) and recurrent neural networks (RNNs) have achieved excellent performance dealing with AD tasks, as well as other challenging domains like image classification, object detection, and speech processing. In this review, we aim to present a comprehensive overview of those research methods using DL to address the AD problem. Firstly, different classifications of anomalies are introduced, and then the DL methods and architectures used for video AD are discussed and analyzed, respectively. The revised contributions have been categorized by the network type, architecture model, datasets, and performance metrics that are used to evaluate these methodologies. Moreover, several applications of video AD have been discussed. Finally, we outlined the challenges and future directions for further research in the field.

Novel Deep Feature Fusion Framework for Multi-Scenario Violence Detection

“…This research assessed the pre-trained and proposed solutions, evaluating their performance using various metrics, including accuracy, recall, precision, and F1 score [1,13]. The accuracy metric measures the model's ability to predict violent video behaviours based on the test images.…”

“…Anomaly behaviour refers to actions that deviate from the usual norms within a given context. Regarding computer vision (CV), anomalies are identified via data patterns showing significant deviations from normal data [1]. Regrettably, significant amounts of time and money are dedicated to monitor and detect these activities without the support of automated systems [2].…”

Deep Learning-Based Fire Detection for Enhanced Safety Systems

“…These evaluation criteria encompass accuracy, precision, recall, and F1-score. The subsequent explanations outline the definitions of these metrics [5]:…”

“…With the advent of IoT-enabled smart cities, it becomes increasingly important to ensure the safety of citizens and their properties [4]. Deep learning for detection and recognition is an integral part of computer vision technologies [5]. The strength of using video in fire detection lies in its ability to monitor large and open spaces.…”

A Survey on Business Intelligence Approach Based on Deep Learning

“…DL leverages NN models to automatically extract features from input data, obviating the need for feature extraction stages. This method can efficiently classify vast and complex data and does not require preprocessing steps for feature description acquisition, making it an advantageous alternative [2]. The integration of BI and DL can revolutionize how businesses analyze data, as traditional BI tools have limitations in terms of data variety and capacity, as well as the inability to learn from data.…”