Proof-of-Concept Techniques for Generating Synthetic Thermal Facial Data for Training of Deep Learning Models

Abstract

Thermal imaging has played a dynamic role in the diversified field of consumer technology applications. To build artificially intelligent thermal imaging systems, large scale thermal datasets are required for successful convergence of complex deep learning models. In this study, we have highlighted various techniques for generating large scale synthetic facial thermal data using both public and locally gathered datasets. It includes data augmentation, synthetic data generation using StyleGAN network, and 2D to 3D image reconstruction using deep learning architectures. Training and validation accuracy of Wide ResNet CNN for binary gender recognition task is improved by 4.6% and 4.4% using original and newly generated synthetic data with an overall test accuracy of 83.33%.

Transfer learning using infrared and optical full motion video data for gender classification

“…The ODU Vision Lab has ongoing work in gender classification and person classification using optical and infrared special purpose sensors [1][2][3][4][5]. Infrared sensors compliment the abilities of visual range sensors for human subject analysis including face recognition [6][7][8][9], action recognition [10][11][12][13][14], and gender [15][16][17][18][19][20] and identity [20][21][22][23][24][25][26] recognition. These sensors may be deployed in the field with a small amount of training data available to establish recognition models.…”