A Flexible Algorithm for Detecting Challenging Moving Objects in Real-Time within IR Video Sequences

Abstract

Real-time detecting moving objects in infrared video sequences may be particularly challenging because of the characteristics of the objects, such as their size, contrast, velocity and trajectory. Many proposed algorithms achieve good performances but only in the presence of some specific kinds of objects, or by neglecting the computational time, becoming unsuitable for real-time applications. To obtain more flexibility in different situations, we developed an algorithm capable of successfully dealing with small and large objects, slow and fast objects, even if subjected to unusual movements, and poorly-contrasted objects. The algorithm is also capable to handle the contemporary presence of multiple objects within the scene and to work in real-time even using cheap hardware. The implemented strategy is based on a fast but accurate background estimation and rejection, performed pixel by pixel and updated frame by frame, which is robust to possible background intensity changes and to noise. A control routine prevents the estimation from being biased by the transit of moving objects, while two noise-adaptive thresholding stages, respectively, drive the estimation control and allow extracting moving objects after the background removal, leading to the desired detection map. For each step, attention has been paid to develop computationally light solution to achieve the real-time requirement. The algorithm has been tested on a database of infrared video sequences, obtaining promising results against different kinds of challenging moving objects and outperforming other commonly adopted solutions. Its effectiveness in terms of detection performance, flexibility and computational time make the algorithm particularly suitable for real-time applications such as intrusion monitoring, activity control and detection of approaching objects, which are fundamental task in the emerging research area of Smart City.

Effects of Vehicular Communication on Risk Assessment in Automated Driving Vehicles

“…Although the amount of signal returned is tiny, radio signals can easily be detected and amplified. RADAR sensors are also known to have sufficient robustness to function reliably under harsh environmental conditions for extended periods of time [12].…”

Abnormal visual event detection based on multi‐instance learning and autoregressive integrated moving average model in edge‐based Smart City surveillance

“…Abnormal event detection can be applied to emerging area of Smart City application, such as intrusion detection, activity control, and traffic monitoring. 6,7 Real-time abnormal event detection is essential for timely identifying warning signs of danger. However, it is often costly and even impossible to detect abnormal events only by manual means.…”

A Level Set Method for Infrared Image Segmentation Using Global and Local Information

“…Infrared (IR) imaging system that passively receives IR radiation (760 nm-1 mm) and converts the invisible rays into images has been extensively applied in remote sensing [1,2]. Infrared (IR) image segmentation is one of the most important techniques in IR systems and plays a fundamental role in many modern remote sensing applications, e.g., unmanned aerial vehicle navigation, pedestrian surveillance, space warning and oil leakage detection [3].…”