Proposing Gesture Recognition Algorithm Using Two-Stream Convolutional Network and LSTM

Huu, Phat Nguyen; Ngoc, Tien Luong; Minh, Quang Tran

doi:10.1109/icce48956.2021.9352147

Cited by 1 publication

(1 citation statement)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Gesture, as an important medium of human-computer interaction, has become one of the hotspots of research in academia and industry [2]. Currently, gesture recognition is mainly realized by devices such as sensors [3,4], cameras [5,6] , radar [7] and Wi-Fi [8]. Among them, sensor-based gesture recognition schemes require users to wear sensors, resulting in limited application scenarios; recognition of gestures based on visual sensors such as cameras is susceptible to light and occlusion, which leads to a significant reduction in recognition performance.…”

Section: Introductionmentioning

confidence: 99%

Research on WiFi human gesture recognition system based on hybrid model of DSC-SGRU

He,

Zhao,

et al. 2024

Preprint

View full text Add to dashboard Cite

Wi-Fi wireless sensing technology has become a research hotspot in the field of perception, which can realize the intelligent perception of human activities and the surrounding environment. Aiming at the problem that the existing wireless sensing models have a large number of parameters, which makes it difficult to sense in real-time in scenarios with limited computing power, such as mobile devices, a lightweight feature extraction module based on Depthwise Separable Convolution (DSC) mixed with Stacked Gate Recur-rent Unit (SGRU) is proposed as a recognition model. The model first captures the spatial features of human gestures using DSC and keeps the temporal characteristics of the features unchanged, and then learns the spatio-temporal characteristics of the gestures using the SGRU network. The performance of the model is validated using the open source dataset Widar. The results show that the proposed DSC-SGRU model has only 236.891 K parameters with an accuracy of 77.6\%. Compared with existing gesture recognition models, DSC-SGRU greatly reduces the number of parameters of the model with approximate performance.

show abstract