Comparative Evaluation of Background Subtraction Algorithms in Remote Scene Videos Captured by MWIR Sensors

Abstract

Background subtraction (BS) is one of the most commonly encountered tasks in video analysis and tracking systems. It distinguishes the foreground (moving objects) from the video sequences captured by static imaging sensors. Background subtraction in remote scene infrared (IR) video is important and common to lots of fields. This paper provides a Remote Scene IR Dataset captured by our designed medium-wave infrared (MWIR) sensor. Each video sequence in this dataset is identified with specific BS challenges and the pixel-wise ground truth of foreground (FG) for each frame is also provided. A series of experiments were conducted to evaluate BS algorithms on this proposed dataset. The overall performance of BS algorithms and the processor/memory requirements were compared. Proper evaluation metrics or criteria were employed to evaluate the capability of each BS algorithm to handle different kinds of BS challenges represented in this dataset. The results and conclusions in this paper provide valid references to develop new BS algorithm for remote scene IR video sequence, and some of them are not only limited to remote scene or IR video sequence but also generic for background subtraction. The Remote Scene IR dataset and the foreground masks detected by each evaluated BS algorithm are available online: .

ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display

“…It works on the principle of assuming that the background is static and thus the comparison of two frames can be used to identify differences. In the case of videos which have been recorded in low light, an extra image noise needs to be removed for a better recognition [ 39 ]. ARTYCUL aimed at processing CCTV video streams; therefore, background subtraction would require extra computation and may not have given accurate results.…”

A Comprehensive Survey of Video Datasets for Background Subtraction

“…This dataset [155] contains realistic videos representing several background subtraction challenges: camouflage, video noise, camera jitter, dynamic background, foreground size, speed of the foreground, and ghosts. All video sequences were recorded in 2017 with a medium-wave infrared sensor, designed by the authors.…”

Automatic foreground detection based on KDE and binary classification

“…Despite their promising performances, they generate some misclassified pixels, especially if the background and the foreground have the same color, and because they also ignore the spatial dependencies of neighboring pixels. While, models based on texture features [3] have demonstrated a certain degree of success in exploiting the spatial correlation, they consider discriminative texture measure as features to distinguish moving pixels from the background. Although, they still have some shortcomings like the use of a threshold to detect the moving pixels.…”