3D Skeleton Estimation and Human Identity Recognition Using Lidar Full Motion Video

Transfer learning using infrared and optical full motion video data for gender classification

“…The ability to classify subject gender is one of many tasks that can help a real-world security effort to recognize or analyze human identity and behavior. This work continues an effort by our lab [1][2][3][4][5] to analyze human subject data using special sensors including MoCap and LIDAR.…”

“…The ODU Vision Lab has ongoing work in gender classification and person classification using optical and infrared special purpose sensors [1][2][3][4][5]. Infrared sensors compliment the abilities of visual range sensors for human subject analysis including face recognition [6][7][8][9], action recognition [10][11][12][13][14], and gender [15][16][17][18][19][20] and identity [20][21][22][23][24][25][26] recognition.…”

“…We also analyzed an infrared LIDAR dataset collected at the Army Night Vision Lab. Using novel silhouette, gait, and depth features we extract a skeleton representation that resembles the MoCap skeleton [2]. We also used this small LIDAR dataset to learn identity by augmenting the data with generative adversarial network samples [3].…”

“…Machine learning based on handcrafted features, and deep learning based on automated feature (representation [27]) learning. In prior work [2], we established the potential for skeleton extraction using the information rich data modality, LIDAR, and applied the extracted skeletons for human identification. In addition [2], we apply a matrix completion algorithm to estimate the position of occluded human limbs.…”

“…In prior work [2], we established the potential for skeleton extraction using the information rich data modality, LIDAR, and applied the extracted skeletons for human identification. In addition [2], we apply a matrix completion algorithm to estimate the position of occluded human limbs. There is a body of existing work using LIDAR with deep learning method.…”