Haptic Glove and Platform with Gestural Control for Neuromorphic Tactile Sensory Feedback in Medical Telepresence

Abstract

The advancements in the study of the human sense of touch are fueling the field of haptics. This is paving the way for augmenting the sensory perception during objects palpation in tele-surgery, and reproducing the information through tactile feedback. Here, we present a novel tele-palpation apparatus that enables the user to detect nodules with various distinct stiffness buried in an ad-hoc polymeric phantom. The contact force measured by the platform was encoded using a neuromorphic model and reproduced on the index fingertip of a remote user through a haptic glove embedding a piezoelectric disk. We assessed the effectiveness of this feedback in allowing nodule identification under two experimental conditions of real-time telepresence: In Line of Sight (ILS), where the platform was placed in the visible range of a user; and the more demanding Not In Line of Sight (NILS), with the platform being 50 km apart. We found that the entailed percentage of identification was higher for stiffer inclusions with respect to the softer ones (average of 74% within the duration of the task), in both telepresence conditions evaluated. These promising results call for further exploration of tactile augmentation technology for telepresence in medical interventions.

Key requirements of a video-call system in a critical care department as discovered during the rapid development of a solution to address COVID-19 visitor restrictions

“…More broadly, recent studies around telepresence and telepresence robots have shown their potential in clinical settings. 26 , 27 Advances in those areas allied with advances in the field of haptics, 28 , 29 may help to address the unmet need around tactile interaction between patients and families, identified above—this warrants further research.…”

Gastroenterology in the Metaverse: The dawn of a new era?

“…Of course, tactile gloves are inextricably linked to the virtual reality interactive simulation system, no matter how powerful they are (34). As an important medium for people to experience the Metaverse, the continuous development of tactile gloves can not only provide a more realistic touch for everyone who experiences the metaverse, but more importantly, it will lay a solid foundation for the future application of the Metaverse in the field of gastroenterology (35). It can be said that only when haptic gloves achieve more accurate feedback and lower latency can virtual endoscopic training and even future remote endoscopic surgery truly achieve truly ideal results.…”