A real-time personal authentication system based on incremental feature extraction and classification of audiovisual information

Abstract

We propose a new approach to a real-time personal authentication system based on incrementally updated visual (face) and audio (voice) features of persons. The proposed system consists of real-time face detection, incremental audiovisual feature extraction, and incremental neural classifier model with long-term memory. The face detection part, a biologically motivated face-color preferable selective attention model first localizes face candidate regions in natural scenes, and then the Adaboost-based face detection identifies human faces from the localized facecandidate regions. The mel-frequency cepstral coefficient is used for vocal feature extraction of speakers. Moreover, incremental principal component analysis (IPCA) is used to reduce the dimensions of audiovisual features and to update them incrementally. The features extracted by IPCA is fed to the resource allocating network with long-term memory which learns facial and vocal features incrementally and recognizes faces in real time. Experimental results show that the proposed system can enhance the test performance incrementally without serious forgetting. In addition, a multi-modal (facial and vocal) feature effectively increases the robustness of the personal authentication system in noisy environments.

Acquisition system and approximation of brain signals

“…The work of [36] improves both convergence and steady-state mean-square error (MSE) performance of the adaptive sparse-interpolated Volterra filter. From the above studies, two interesting interpolation methods are highly considered as are the least squares of [19,[22][23][24][25][26][27][28][29][30][31][32]34], and the nearest neighbour of [20,21,33]. Since this paper is focused in this issue, it would be interesting to design a novel interpolation method for the approximation of non-linear behaviours.…”

“…There are two kinds of signal approximation: one is the estimation of parameters [1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16][17][18], and the other is the interpolation [19][20][21][22][23][24][25][26][27][28][29][30][31][32][33][34][35][36].…”