Ultra-thin crystalline silicon-based strain gauges with deep learning algorithms for silent speech interfaces

Abstract

A wearable silent speech interface (SSI) is a promising platform that enables verbal communication without vocalization. The most widely studied methodology for SSI focuses on surface electromyography (sEMG). However, sEMG suffers from low scalability because of signal quality-related issues, including signal-to-noise ratio and interelectrode interference. Hence, in this study, we present a novel SSI by utilizing crystalline-silicon-based strain sensors combined with a 3D convolutional deep learning algorithm. Two perpendicularly placed strain gauges with minimized cell dimension (< 0.1 mm2) could capture the biaxial strain information with high reliability. We attached four strain sensors near the subject’s mouths and collected strain data of unprecedently large wordsets (100 words), which our SSI can classify at a high accuracy rate (87.53%). Several analysis methods were demonstrated to verify the system’s reliability, as well as the performance comparison with another SSI using sEMG electrodes with the same dimension, which exhibited an accuracy rate of 35.00%.

Soft Wireless Headband Bioelectronics and Electrooculography for Persistent Human–Machine Interfaces

“…To address the gel issues such as skin irritation and short-term durability, we introduce ultrathin, dry electrodes. In recent papers, with its well-studied biocompatibility and processibility, mesh-patterned gold electrodes have been widely used to measure biopotentials. , Specifically, the ultrathin, fractal-designed gold electrode can help the electrode accommodate dynamic skin deformation for a high-fidelity recording of EOG and causes fewer skin irritations compared to the existing gel electrodes. Also, the wearable EOG device can acquire EOG data and classify eye directions in real-time.…”