Multiscale haptic interfaces for metaverse

Wang, Yuanyi; Liang, Jiamin; Yu, Jinke; Shan, Yao; Huang, Xin; Lin, Weikang; Pan, Qiqi; Zhang, Tianlong; Zhang, Zhengyou; Gao, Yongsheng; Yu, Xinge; Wei, Lei; Yang, Zhengbao

doi:10.1016/j.device.2024.100326

Device

2024

DOI: 10.1016/j.device.2024.100326

|View full text |Cite

Multiscale haptic interfaces for metaverse

Yuanyi Wang,

Jiamin Liang,

Jinke Yu

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article3

Relationship

Self Cite0

Independent3

Authors

Journals

Cited by 3 publications

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

A Real‐Time Imaging Sensing System to Visualize Elastomer Surface Profile Evolution for Dynamic Tactile Recognition

Zou,

Li,

Zhou

et al. 2024

Adv Funct Materials

View full text Add to dashboard Cite

Elastomer‐based interfaces provide rich functionalities for tactile sensing, particularly in making tiny differences in contact dynamics potentially detectable. However, the minimal motion‐induced changes in the elastomer's surface and their disappearance during time‐lapse limit the state recognition within the current scheme of motion recognition. In this work, a new scheme of real‐time motion mode recognition for subtle deformations is proposed, which uses an optical tactile sensing system to visualize and distinguish tiny variations in surface profile evolution encoded as images. Illustrating with a sphere, sliding‐induced asymmetric elastomer surface deformation is visualized as a “drag” in optical images. The convolutional neural network (CNN) algorithm is used to analyze the evolution of surface contour features during the interaction between the sphere and the elastic medium. Motion state recognition is achieved with 80% accuracy when a displacement of only 8.3% of the sphere diameter is produced. In addition, the system also offers the potential to analyze dynamic motion information through a single image, with an accuracy of 82.7% for velocity recognition. This dynamic real‐time recognition framework for soft media deformation paves the way for novel motion‐based input commands for tactile sensing and human‐computer interaction applications.

show abstract

A Real‐Time Imaging Sensing System to Visualize Elastomer Surface Profile Evolution for Dynamic Tactile Recognition

Zou,

Li,

Zhou

et al. 2024

Adv Funct Materials

View full text Add to dashboard Cite

show abstract

Programmable Chemical Reactions Enable Ultrastrong Soft Pneumatic Actuation

Qu,

Tang,

Zhong

et al. 2024

Advanced Materials

View full text Add to dashboard Cite

Soft pneumatic actuation is widely used in wearable devices, soft robots, artificial muscles, and surgery machines. However, generating high‐pressure gases in a soft, controllable, and portable way remains a substantial challenge. Here, a class of programmable chemical reactions that can be used to controllably generate gases with a maximum pressure output of nearly 6 MPa is reported. It is proposed to realize the programmability of the chemical reaction process using thermoelectric material with programmable electric current and employing preprogrammed reversible chemical reactants. The programmable chemical reactions as soft pneumatic actuation can be operated independently as miniature gas sources (∼20–100 g) or combined with arbitrary physical structures to make self‐contained machines, capable of generating unprecedented pressures of nearly 6 MPa or forces of about 18 kN in a controllable, portable, and silent manner. Striking demonstrations of breaking a brick, a marble, and concrete blocks, raising a sightseeing car, and successful applications in artificial muscles and soft assistive wearables illustrate tremendous application prospects of soft pneumatic actuation via programmable chemical reactions. The study establishes a new paradigm toward ultrastrong soft pneumatic actuation.

show abstract

Triboelectric Mat Multimodal Sensing System (TMMSS) Enhanced by Infrared Image Perception for Sleep and Emotion‐Relevant Activity Monitoring

Xu,

Guo,

Zhang

et al. 2024

Advanced Science

View full text Add to dashboard Cite

To implement digital‐twin smart home applications, the mat sensing system based on triboelectric sensors is commonly used for gait information collection from daily activities. Yet traditional mat sensing systems often miss upper body motions and fail to adequately project these into the virtual realm, limiting their specific application scenarios. Herein, triboelectric mat multimodal sensing system is designed, enhanced with a commercial infrared imaging sensor, to capture diverse sensory information for sleep and emotion‐relevant activity monitoring without compromising privacy. This system generates pixel‐based area ratio mappings across the entire mat array, solely based on the integral operation of triboelectric outputs. Additionally, it utilizes multimodal sensory intelligence and deep‐learning analytics to detect different sleeping postures and monitor comprehensive sleep behaviors and emotional states associated with daily activities. These behaviors are projected into the metaverse, enhancing virtual interactions. This multimodal sensing system, cost‐effective and non‐intrusive, serves as a functional interface for diverse digital‐twin smart home applications such as healthcare, sports monitoring, and security.

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Multiscale haptic interfaces for metaverse

Cited by 3 publications

References 29 publications

A Real‐Time Imaging Sensing System to Visualize Elastomer Surface Profile Evolution for Dynamic Tactile Recognition

A Real‐Time Imaging Sensing System to Visualize Elastomer Surface Profile Evolution for Dynamic Tactile Recognition

Programmable Chemical Reactions Enable Ultrastrong Soft Pneumatic Actuation

Triboelectric Mat Multimodal Sensing System (TMMSS) Enhanced by Infrared Image Perception for Sleep and Emotion‐Relevant Activity Monitoring

Contact Info

Product

Resources

About