Robotic interfaces for cognitive psychology and embodiment research: A research roadmap

Abstract

Advanced human–machine interfaces render robotic devices applicable to study and enhance human cognition. This turns robots into formidable neuroscientific tools to study processes such as the adaptation between a human operator and the operated robotic device and how this adaptation modulates human embodiment and embodied cognition. We analyze bidirectional human–machine interface (bHMI) technologies for transparent information transfer between a human and a robot via efferent and afferent channels. Even if such interfaces have a tremendous positive impact on feedback loops and embodiment, advanced bHMIs face immense technological challenges. We critically discuss existing technical approaches, mainly focusing on haptics, and suggest extensions thereof, which include other aspects of touch. Moreover, we point out other potential constraints such as limited functionality, semi‐autonomy, intent‐detection, and feedback methods. From this, we develop a research roadmap to guide understanding and development of bidirectional human–machine interfaces that enable robotic experiments to empirically study the human mind and embodiment. We conclude the integration of dexterous control and multisensory feedback to be a promising roadmap towards future robotic interfaces, especially regarding applications in the cognitive sciences. This article is categorized under: Computer Science > Robotics Psychology > Motor Skill and Performance Neuroscience > Plasticity

Embodiment, Presence, and Their Intersections

“…This seems promising, as embodiment research appears to have a broader and more solid theoretical foundation in psychological research. For instance, recent approaches of researching body illusions follow a bottom-up manner from single, not animated body parts to robotic hands or virtual bodies [11]. Arguably, teleoperation research followed an opposite route, starting on top with the idea of the perfect illusion while developing the theoretical groundwork of the concept only over time, with still mixed results.…”

“…All those experiments substantiate the importance of multisensory integration processes and modulate embodiment and its subcomponents through specific experimental paradigms. For instance, embodiment is reduced through asynchronous multisensory feedback or influenced by deviations in robotic limb control [11].…”

Toward Enhanced Teleoperation Through Embodiment

“…Affective touch (e.g., slow stroking) effectively induces a strong sense of ownership (Haans et al, 2012;Crucianelli et al, 2013Crucianelli et al, , 2018Lloyd et al, 2013;van Stralen et al, 2014;de Jong et al, 2017). Finally, bi-directional human-machine interfaces may serve to enhance ownership and agency by integrating intent detection and multi-sensory feedback through co-adaptation (the process through which the robotic device adapts to its human operator/user while the human adapts to the device: Beckerle et al, 2019).…”

Can Wearable Haptic Devices Foster the Embodiment of Virtual Limbs?

“…The experimental setup of the rubber hand illusion can be extended using virtual or robotic hands [4], [19], [20], [21], [22], [23]. Virtual reality techniques provide a promising method to study body representation and its perception, allowing the simulation of conditions that cannot be reproduced in the real world [24], [25] .…”