Gait‐based human recognition based on millimetre wave multiple input multiple output radar point cloud constructed using velocity‐depth‐time

Abstract

Gait recognition is to recognise different individuals based on their faint differences of gait characteristics, which is different from and more challengeable than the recognition of human activities based on relatively bigger differences between different motions. Existing millimetre‐wave Multiple Input Multiple Output radar point cloud data contains time‐varying three‐dimensional spatial positions, velocity, and intensity information. How to enhance the accuracy of gait recognition by effectively utilising the available radar point cloud data has become an attractive research topic in recent years. A velocity‐depth‐time (VDT) based point cloud construction method for millimetre‐wave Multiple Input Multiple Output radar is proposed for gait recognition application, which can not only alleviate the sparsity problem of mmWave point cloud but also make the constructed point cloud to exhibit temporal structural features of micro‐motions, and therefore enable the successful application of PointNet++ to mmWave‐MIMO point cloud gait recognition. New point clouds are constructed by the proposed method using public gait recognition datasets of 10 and 20 individuals from mmWave‐MIMO radar, which are used to conduct gait recognition experiments using PointNet++. The results show that the point clouds constructed based on VDT are more conducive to the gait recognition task. Even using the classic PointNet++ model, which is not specially designed for radar point clouds, high recognition accuracy can be achieved for gait recognition tasks. The recognition accuracies are improved by 11% and 12% in this work for datasets of 10 and 20 individuals, respectively, compared with the 84% and 80% achieved by the traditional method using the same dataset and the same PointNet++ model, while the accuracies are improved by 5% and 12%, respectively, compared with the 90% and 80% achieved by the original dataset thesis method corresponding to 10‐individual and 20‐individual datasets.