A Real-Time Framework for Human Face Detection and Recognition in CCTV Images

Abstract

This paper aims to develop a machine learning and deep learning-based real-time framework for detecting and recognizing human faces in closed-circuit television (CCTV) images. The traditional CCTV system needs a human for 24/7 monitoring, which is costly and insufficient. The automatic recognition system of faces in CCTV images with minimum human intervention and reduced cost can help many organizations, such as law enforcement, identifying the suspects, missing people, and people entering a restricted territory. However, image-based recognition has many issues, such as scaling, rotation, cluttered backgrounds, and variation in light intensity. This paper aims to develop a CCTV image-based human face recognition system using different techniques for feature extraction and face recognition. The proposed system includes image acquisition from CCTV, image preprocessing, face detection, localization, extraction from the acquired images, and recognition. We use two feature extraction algorithms, principal component analysis (PCA) and convolutional neural network (CNN). We use and compare the performance of the algorithms K-nearest neighbor (KNN), decision tree, random forest, and CNN. The recognition is done by applying these techniques to the dataset with more than 40K acquired real-time images at different settings such as light level, rotation, and scaling for simulation and performance evaluation. Finally, we recognized faces with a minimum computing time and an accuracy of more than 90%.

Tracking Missing Person in Large Crowd Gathering Using Intelligent Video Surveillance

“…The authors Ullah, R. et al [ 10 ] proposed a real-time framework for human face detection and recognition in CCTV images over a 40 K images with different environmental condition, background and occlusions. In addition, they performed a comparison analysis between different machine / deep learning algorithms such as decision trees, random forest, K-NN and CNN.…”

Subject Behavior Detection and Analysis Based on Computer Vision Technology

“…The purpose of face recognition is to find out if there are faces in an image or video [9]. The detection results provide parameters for the location of the face and may be required in many views, such as a rectangle overlaying the central part of the face (Fig.…”

A Deep-Learning Model for Real-Time Red Palm Weevil Detection and Localization

“…Computer software tools are increasingly coming into use in the fields of agriculture, crop- and weed-detection differentiation and control. The faster R-CNN model was used to develop a Regional Convolutional 3D Network for object detection [ 14 , 15 , 16 ]. The use of the IoT-enabled environments was addressed by using information technology for realizing the implementation of smart cities [ 17 ].…”

“…The framework is traditionally trained by alternating phase-one and phase-two training. Faster R-CNN naturally extends the temporal localization [ 13 , 14 , 15 ]. The aim of object detection is to detect 2D spatial regions, while in temporal procedure localization, the goal is to detect 1D temporal segments, each representing a start and end time.…”