3D Heterogeneous Sensing System for Multimode Parrallel Signal No‐Spatiotemporal Misalignment Recognition

Abstract

The spatiotemporal error caused by planar tiled structure design and the waste of communication resources brought on by the transmission of a single channel are two challenges facing the development of multifunctional intelligent sensors with high‐density integration. A homo‐spatiotemporal multisensory parallel transmission system (HMPTs) is expanded to realize multisignal no‐spatiotemporal misalignment recognition and efficient parallel transmission. First, this system optimizes the distribution of multifunctional sensors, completes the 3D vertical heterogeneous layout of four sensors, and achieves material multi‐information detection at a single place with no‐spatiotemporal deviation. Additionally, the system couples and transmittes multiple sensory signals, delivering a fourfold increase in transmission efficiency and one‐third of the power consumption compared to a single‐channel transmission system. Finally, this system is used for the recognition of mixed materials, and human‐computer interaction to realize the assignment of materials in VR, demonstrating the great accuracy and transmission efficiency of HMPTs as well as its feasibility in practical application. This is an a priori effort to enhance machine perception accuracy, improve signal transmission effectiveness, and advance human‐machine‐object triadic integration.