Novel augmented reality interface using a self-powered triboelectric based virtual reality 3D-control sensor

Chen, Tao; Zhao, Mingyue; Shi, Qiongfeng; Yang, Zhan; Liu, Huicong; Sun, Lining; Ouyang, Jianyong; Lee, Chengkuo

doi:10.1016/j.nanoen.2018.06.022

Cited by 79 publications

(48 citation statements)

References 59 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Owing to the recent advances and the rapid development in soft materials and micro-electromechanical system (MEMS) fabrication, the emerging field of wearable flexible electronic devices offers a technological solution to measure the sEMG of the face, jaw, neck, etc. [11][12][13][14][15][16][17][18][19][20][21][22][23] . One of the major trends is to apply textiles made of functional yearns and coatings or to use flexible materials to fabricate devices for detecting physiological signals [24][25][26] , conducting drug delivery 27 , and realizing intuitive humanmachine interfaces [28][29][30][31] .…”

Section: Introductionmentioning

confidence: 99%

An epidermal sEMG tattoo-like patch as a new human–machine interface for patients with loss of voice

et al. 2020

Self Cite

View full text Add to dashboard Cite

Throat cancer treatment involves surgical removal of the tumor, leaving patients with facial disfigurement as well as temporary or permanent loss of voice. Surface electromyography (sEMG) generated from the jaw contains lots of voice information. However, it is difficult to record because of not only the weakness of the signals but also the steep skin curvature. This paper demonstrates the design of an imperceptible, flexible epidermal sEMG tattoo-like patch with the thickness of less than 10 μm and peeling strength of larger than 1 N cm −1 that exhibits large adhesiveness to complex biological surfaces and is thus capable of sEMG recording for silent speech recognition. When a tester speaks silently, the patch shows excellent performance in recording the sEMG signals from three muscle channels and recognizing those frequently used instructions with high accuracy by using the wavelet decomposition and pattern recognization. The average accuracy of action instructions can reach up to 89.04%, and the average accuracy of emotion instructions is as high as 92.33%. To demonstrate the functionality of tattoo-like patches as a new human-machine interface (HMI) for patients with loss of voice, the intelligent silent speech recognition, voice synthesis, and virtual interaction have been implemented, which are of great importance in helping these patients communicate with people and make life more enjoyable.

show abstract

Section: Introductionmentioning

confidence: 99%

An epidermal sEMG tattoo-like patch as a new human–machine interface for patients with loss of voice

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…As shown in Figure 11a, a self-powered 3D-control sensor was presented. When the suspending sphere contacted with the bottom surface under human actuation, the generated charges on the contact area can be detected by the corresponding electrodes [172]. Thus, through signal analysis on the eight electrodes' output, 3D force information (normal force and shear force with different directions) can be achieved and applied for the object attitude control with six degrees of freedom.…”

Section: Interface Of Sensormentioning

confidence: 99%

“…With the rapid development of the information industry and human-machine interface technology in recent years, VR technology and augmented reality (AR) technology have become a hot research topic when combined with MEMS/NEMS wearable devices to form a whole interactive system in 3D space. This kind of interactive system provides users with a more immersive experience and has the potential to be used in many application scenarios, such as sports training simulation, medical rehabilitation, entertainment and so on [172,174,[189][190][191][192][193][194]. Apart from the software part which providing an actual interactive 3D environment, the integrated sensors collecting user's motion, force, and tactile sensation information [195][196][197] also play an important role in the whole VR/AR interactive system.…”

Section: Toward Vr and Armentioning

confidence: 99%

Development Trends and Perspectives of Future Sensors and MEMS/NEMS

et al. 2019

Self Cite

View full text Add to dashboard Cite

With the fast development of the fifth-generation cellular network technology (5G), the future sensors and microelectromechanical systems (MEMS)/nanoelectromechanical systems (NEMS) are presenting a more and more critical role to provide information in our daily life. This review paper introduces the development trends and perspectives of the future sensors and MEMS/NEMS. Starting from the issues of the MEMS fabrication, we introduced typical MEMS sensors for their applications in the Internet of Things (IoTs), such as MEMS physical sensor, MEMS acoustic sensor, and MEMS gas sensor. Toward the trends in intelligence and less power consumption, MEMS components including MEMS/NEMS switch, piezoelectric micromachined ultrasonic transducer (PMUT), and MEMS energy harvesting were investigated to assist the future sensors, such as event-based or almost zero-power. Furthermore, MEMS rigid substrate toward NEMS flexible-based for flexibility and interface was discussed as another important development trend for next-generation wearable or multi-functional sensors. Around the issues about the big data and human-machine realization for human beings’ manipulation, artificial intelligence (AI) and virtual reality (VR) technologies were finally realized using sensor nodes and its wave identification as future trends for various scenarios.

show abstract

“…[48][49][50][51][52][53][54][55][56] During the past few years, various triboelectric interfaces have been developed toward a wide range of detection and control applications. [60][61][62][63][64][65][66][67][68][69] For each of the motion control, individual sensing node is required as well as sensing electrodes. Pressing-type interface is normally realized by contact-separation mode-based pressure or tactile sensors, in order to detect the pressing on the interface for motion control.…”

Section: Introductionmentioning

confidence: 99%

“…Pressing-type interface is normally realized by contact-separation mode-based pressure or tactile sensors, in order to detect the pressing on the interface for motion control. [60] The 3D tactile sensor in total has eight sensing nodes/electrodes to detect different operation motions (two finger pressing on both sides of the device) for 3D control. To give an example, a flexible and transparent TENG interface using array of multiple tactile sensors is demonstrated for the detection and mapping of finger contact, which then can be further applied for gaming control.…”

Section: Introductionmentioning

confidence: 99%

Self‐Powered Bio‐Inspired Spider‐Net‐Coding Interface Using Single‐Electrode Triboelectric Nanogenerator

2019

Self Cite

View full text Add to dashboard Cite

Human–machine interfaces are essential components between various human and machine interactions such as entertainment, robotics control, smart home, virtual/augmented reality, etc. Recently, various triboelectric‐based interfaces have been developed toward flexible wearable and battery‐less applications. However, most of them exhibit complicated structures and a large number of electrodes for multidirectional control. Herein, a bio‐inspired spider‐net‐coding (BISNC) interface with great flexibility, scalability, and single‐electrode output is proposed, through connecting information‐coding electrodes into a single triboelectric electrode. Two types of coding designs are investigated, i.e., information coding by large/small electrode width (L/S coding) and information coding with/without electrode at a predefined position (0/1 coding). The BISNC interface shows high scalability with a single electrode for detection and/or control of multiple directions, by detecting different output signal patterns. In addition, it also has excellent reliability and robustness in actual usage scenarios, since recognition of signal patterns is in regardless of absolute amplitude and thereby not affected by sliding speed/force, humidity, etc. Based on the spider‐net‐coding concept, single‐electrode interfaces for multidirectional 3D control, security code systems, and flexible wearable electronics are successfully developed, indicating the great potentials of this technology in diversified applications such as human–machine interaction, virtual/augmented reality, security, robotics, Internet of Things, etc.

show abstract

Novel augmented reality interface using a self-powered triboelectric based virtual reality 3D-control sensor

Cited by 79 publications

References 59 publications

An epidermal sEMG tattoo-like patch as a new human–machine interface for patients with loss of voice

An epidermal sEMG tattoo-like patch as a new human–machine interface for patients with loss of voice

Development Trends and Perspectives of Future Sensors and MEMS/NEMS

Self‐Powered Bio‐Inspired Spider‐Net‐Coding Interface Using Single‐Electrode Triboelectric Nanogenerator

Contact Info

Product

Resources

About