A novel sketch based face recognition in unconstrained video for criminal investigation

Abstract

Face recognition in video surveillance helps to identify an individual by comparing facial features of given photograph or sketch with a video for criminal investigations. Generally, face sketch is used by the police when suspect’s photo is not available. Manual matching of facial sketch with suspect’s image in a long video is tedious and time-consuming task. To overcome these drawbacks, this paper proposes an accurate face recognition technique to recognize a person based on his sketch in an unconstrained video surveillance. In the proposed method, surveillance video and sketch of suspect is taken as an input. Firstly, input video is converted into frames and summarized using the proposed quality indexed three step cross search algorithm. Next, faces are detected by proposed modified Viola-Jones algorithm. Then, necessary features are selected using the proposed salp-cat optimization algorithm. Finally, these features are fused with scale-invariant feature transform (SIFT) features and Euclidean distance is computed between feature vectors of sketch and each face in a video. Face from the video having lowest Euclidean distance with query sketch is considered as suspect’s face. The proposed method’s performance is analyzed on Chokepoint dataset and the system works efficiently with 89.02% of precision, 91.25% of recall and 90.13% of F-measure.

Intelligent face sketch recognition system using shearlet transform and convolutional neural network model

“…In [24] introduce a modified version of the Viola-Jones algorithm for detecting faces in the video frames. The proposed salp-cat optimization algorithm is utilized to select relevant features for further processing.…”

Novel hybrid generative adversarial network for synthesizing image from sketch

“…With constraints towards text-based search, image-based search option is one of the simplest and best option to look for information [2]. However, image-based search can be further more customized when the query image is given in the form of free hand drawing also known as sketch [3]. In this form of search technique, a sketch related to certain real object is drawn by user and it acts as an input to the system which looks for all matching images respective to the sketch.…”