Highlights
Carbon-based gradient resistance element structure is proposed for the construction of multifunctional touch sensor, which will promote wide detection and recognition range of multiple mechanical stimulations.
Multifunctional touch sensor with gradient resistance element and two electrodes is demonstrated to eliminate signals crosstalk and prevent interference during position sensing for humanâmachine interactions.
Biological sensing interface based on a deep-learning-assisted all-in-one multipoint touch sensor enables users to efficiently interact with virtual world.
Abstract
Humanâmachine interactions using deep-learning methods are important in the research of virtual reality, augmented reality, and metaverse. Such research remains challenging as current interactive sensing interfaces for single-point or multipoint touch input are trapped by massive crossover electrodes, signal crosstalk, propagation delay, and demanding configuration requirements. Here, an all-in-one multipoint touch sensor (AIOM touch sensor) with only two electrodes is reported. The AIOM touch sensor is efficiently constructed by gradient resistance elements, which can highly adapt to diverse application-dependent configurations. Combined with deep learning method, the AIOM touch sensor can be utilized to recognize, learn, and memorize humanâmachine interactions. A biometric verification system is built based on the AIOM touch sensor, which achieves a high identification accuracy of over 98% and offers a promising hybrid cyber security against password leaking. Diversiform humanâmachine interactions, including freely playing piano music and programmatically controlling a drone, demonstrate the high stability, rapid response time, and excellent spatiotemporally dynamic resolution of the AIOM touch sensor, which will promote significant development of interactive sensing interfaces between fingertips and virtual objects.