Significant Trajectories and Locality Constrained Linear Coding for Hand Gesture Representation

Tran, Thanh-Hai; Nguyen, Tien Hai; Dinh, Viet Sang

doi:10.1109/icce48956.2021.9352122

Cited by 2 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The use of hand gestures provides an attractive alternative to cumbersome interface devices in human-computer interaction (HCI). In the literature, the number of studies on this topic has significantly increased in recent years due to their wide range of applications [1], [2], [3], [4] in virtual reality, games, and healthcare. In such applications, gestures are acquired by sensors and then automatically inferred and mapped to a finite set of predefined control commands.…”

Section: Introductionmentioning

confidence: 99%

Hand Gesture Recognition From Wrist-Worn Camera for Human–Machine Interaction

Nguyêñ

Tran³

et al. 2023

IEEE Access

Self Cite

View full text Add to dashboard Cite

In this work, we study the ability to use hand gestures for human-machine interaction from wrist-worn sensors. Towards this goal, we design a wrist-worn prototype to capture RGB video stream of hand gestures. Then we built a new wrist-worn gesture dataset (named WiGes) with various subjects in interaction with home appliances in different environments. To the best of our knowledge, this is the first benchmark released for studying hand gestures from a wrist-worn camera. We then evaluate various CNN models for vision-based recognition. Furthermore, we deeply analyze the models that produce the best trade-off between accuracy, memory requirement, and computational cost. We point out that among studied architectures, MoviNet produces the highest accuracy. Then, we introduce a new MoviNet-based two-stream architecture that takes both RGB and optical flow into account. Our proposed architecture increases the Top-1 accuracy by 1.36% and 3.67% according to two evaluation protocols. Our dataset, baselines, and proposed model analysis give instructive recommendations for human-machine interaction using hand-held devices.INDEX TERMS Convolutional neural network, hand gesture recognition, human-machine interaction, wearable sensors.

show abstract