A Pathway into Metaverse: Gesture Recognition Enabled by Wearable Resistive Sensors

Abstract

Hand gesture recognition is of great importance for human–Metaverse interaction. The human hand is relatively smaller, with very complex articulations than the entire human body. Therefore, precise hand gesture recognition, especially in complicated environments, is still a great challenge. Wearable resistive sensors that could directly characterize joint movements are one of the most promising technologies for hand gesture recognition due to their easy integration, low cost, and simple signal acquisition. Here, we summarize common categories of wearable resistive sensors for hand gesture recognition and review the recent advances. Besides, common strategies for improving waterproofness (molecular design, material modification, and interfacial encapsulation) are also outlined. Perspectives on the advantages of combining machine vision and resistive sensors for accurate hand gesture recognition and dynamic hand gesture tracking are then provided. We hope this review could inspire future research in wearable technologies for human–Metaverse systems.

Porous Conductive Textiles for Wearable Electronics

“…Therefore, the development of flexible, lightweight, and thin interactive devices would be crucial to improve wearing comfort. In addition, other sensory inputs such as touch (haptic), smell (olfactory), and temperature (thermal) play essential roles in our perception and understanding of the real world. − Thus, the incorporation of these additional sensory elements into XR devices would enhance the level of immersion and make the experiences more realistic . As a result, extensive research endeavors have been dedicated to exploring the potential applications of flexible and wearable electronics in VR/AR devices. − ,, …”

“…859−862 Thus, the incorporation of these additional sensory elements into XR devices would enhance the level of immersion and make the experiences more realistic. 863 As a result, extensive research endeavors have been dedicated to exploring the potential applications of flexible and wearable electronics in VR/AR devices. [859][860][861]863,864 In VR and AR systems, there are two essential components: input devices and output devices.…”

“…863 As a result, extensive research endeavors have been dedicated to exploring the potential applications of flexible and wearable electronics in VR/AR devices. [859][860][861]863,864 In VR and AR systems, there are two essential components: input devices and output devices. The input devices are responsible for gathering information from the physical environment and the user, while the output devices generate signals or feedback from the processor to stimulate the user's sensory system through appropriate signal transduction.…”

A Flexible Dual‐Mode Capacitive Sensor for Highly Sensitive Touchless and Tactile Sensing in Human‐Machine Interactions

“…HMI technology has evolved from the original mouse to a multi-touch screen and then to advanced posture sensing. [12] However, most of the existing HMIs are reliant on a single mode of interaction and often require users to wear bulky equipment or maintain uninterrupted physical contact with the device. [13,14] This limitation hinders the long-term and efficient interaction between humans and machines.…”

Metaverse Wearables for Immersive Digital Healthcare: A Review

“…[12][13][14][15][16][17] The signals acquired from the wearables are used to drive an avatar in the metaverse or to provide seamless and natural multimodal sensing such as tactile-perception or haptic-feedback. [18][19][20][21] Combining prosthetics with XR technology can also provide immersive experiences for rehabilitation to amputees or visually impaired patients. [22][23][24][25] Healthcare workers are required to complete high-risks training, such as procedures of proper disposal handling of biohazardous substances or rapid responses in surgical scenarios.…”