Convolutional Neural Networks with Fused Layers Applied to Face Recognition

Abstract

In this paper, we propose an e®ective convolutional neural network (CNN) model to the problem of face recognition. The proposed CNN architecture applies fused convolution/ subsampling layers that result in a simpler model with fewer network parameters; that is, a smaller number of neurons, trainable parameters, and connections. In addition, it does not require any complex or costly image preprocessing steps that are typical in existing face recognizer systems. In this work, we enhance the stochastic diagonal Levenberg-Marquardt algorithm, a second-order back-propagation algorithm to obtain faster network convergence and better generalization ability. Experimental work completed on the ORL database shows that a recognition accuracy of 100% is achieved, with the network converging within 15 epochs. The average processing time of the proposed CNN face recognition solution, executed on a 2.5 GHz Intel i5 quad-core processor, is 3 s per epoch, with a recognition speed of less than 0.003 s. These results show that the proposed CNN model is a computationally e±cient architecture that exhibits faster processing and learning times, and also produces higher recognition accuracy, outperforming other existing work on face recognizers based on neural networks.

Transfer Learning with Convolutional Neural Networks for IRIS Recognition

“…A mini-batch is defined as a subset of the training set that is used to evaluate the gradient of the loss function and update the weights. The gradient descent algorithm updates the network parameters (weights and biases) [50].…”

A design of license plate recognition system using convolutional neural network

“…According to Figure 1, it is illustrated the flow chart of overall LPR system phases. The detail algorithm of enhanced SDLM can be referred in [35]. MATLAB and C language has been used as the platform.…”

“…Therefore, Gaussian weight has been used for the rest of the testing. The learning algorithm used in training the CNN is an enhanced version of Stochastic Diagonal Levenberg Marquadt (SDLM) [35] algorithm. This learning algorithm is better than standard backpropagation in which it avoids the gradient from getting trap into the local minima.…”

Fused Convolutional Neural Network for Facial Expression Recognition

“…The seven classes represented by seven full connected layer neurons. To accelerate the convergence process and maintaining the generalization ability, the Stochastic Diagonal Levenberg Marquadt (SDLM) learning algorithm [9] was used.…”