The Influence of Visual Cues on Passive Tactile Sensations in a Multimodal Immersive Virtual Environment

Rosa, Nina; Hürst, Wolfgang; Vos, W.K.; Werkhoven, Peter

doi:10.1145/2818346.2820744

Cited by 23 publications

(16 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In Chapter 4, we concluded that there are no differences between (1) direct or mediated sensorimotor interactions and between (2) real and virtual cues. It is likely that this also holds for Augmented Reality (AR; Rosa et al, 2015 ; Škola and Liarokapis, 2016 ), which opens up new opportunities in telerobotic applications. For instance, AR techniques can be used to manipulate the appearance and perceived tactile properties of artificial body parts or tools and therewith the strength of the ownership illusion in a similar vein as has been demonstrated with VR, and the combination of VR/AR and robotics affords automated induction of embodiment.…”

Section: Recent Developmentsmentioning

confidence: 99%

Toward Enhanced Teleoperation Through Embodiment

et al. 2020

View full text Add to dashboard Cite

Telerobotics aims to transfer human manipulation skills and dexterity over an arbitrary distance and at an arbitrary scale to a remote workplace. A telerobotic system that is transparent enables a natural and intuitive interaction. We postulate that embodiment (with three sub-components: sense of ownership, agency, and self-location) of the robotic system leads to optimal perceptual transparency and increases task performance. However, this has not yet been investigated directly. We reason along four premises and present findings from the literature that substantiate each of them: (1) the brain can embody non-bodily objects (e.g., robotic hands), (2) embodiment can be elicited with mediated sensorimotor interaction, (3) embodiment is robust against inconsistencies between the robotic system and the operator's body, and (4) embodiment positively correlates to dexterous task performance. We use the predictive encoding theory as a framework to interpret and discuss the results reported in the literature. Numerous previous studies have shown that it is possible to induce embodiment over a wide range of virtual and real extracorporeal objects (including artificial limbs, avatars, and android robots) through mediated sensorimotor interaction. Also, embodiment can occur for non-human morphologies including for elongated arms and a tail. In accordance with the predictive encoding theory, none of the sensory modalities is critical in establishing ownership, and discrepancies in multisensory signals do not necessarily lead to loss of embodiment. However, large discrepancies in terms of multisensory synchrony or visual likeness can prohibit embodiment from occurring. The literature provides less extensive support for the link between embodiment and (dexterous) task performance. However, data gathered with prosthetic hands do indicate a positive correlation. We conclude that all four premises are supported by direct or indirect evidence in the literature, suggesting that embodiment of a remote manipulator may improve dexterous performance in telerobotics. This warrants further implementation testing of embodiment in telerobotics. We formulate a first set of guidelines to apply embodiment in telerobotics and identify some important research topics.

show abstract

Section: Recent Developmentsmentioning

confidence: 99%

Toward Enhanced Teleoperation Through Embodiment

et al. 2020

View full text Add to dashboard Cite

show abstract

“…These previous studies support our result that visual stimulus accompanied by color change affects the thermal perception of a human. As stated in previous publications 30,31 , humans create a cross-modal correspondence between color and temperature in the color-thermal direction.…”

Section: Discussionmentioning

confidence: 85%

Thermal display glove for interacting with virtual reality

Kim

et al. 2020

Sci Rep

View full text Add to dashboard Cite

Thermal perception is essential for the survival and daily activities of people. Thus, it is desirable to realize thermal feedback stimulation for improving the sense of realism in virtual reality (VR) for users. For thermal stimulus, conventional systems utilize liquid circulation with bulky external sources or thermoelectric devices (TEDs) on rigid structures. However, these systems are difficult to apply to compact wearable gear used for complex hand motions to interact with VR. Furthermore, generating a rapid temperature difference, especially cooling, in response to a thermal stimulus in real-time is challenging for the conventional systems. To overcome this challenge and enhance wearability, we developed an untethered real-time thermal display glove. this glove comprised piezoelectric sensors enabling hand motion sensing and flexible TEDs for bidirectional thermal stimulus on skin. The customized flexible TEDs can decrease the temperature by 10 °C at room temperature in less than 0.5 s. Moreover, they have sufficiently high durability to withstand over 5,000 bends and high flexibility under a bending radius of 20 mm. In a user test with 20 subjects, the correlation between thermal perception and the displayed object's color was verified, and a survey result showed that the thermal display glove provided realistic and immersive experiences to users when interacting with VR. People perceive various stimuli from the surrounding environment by using the sensory receptors of the body. This allows them to comprehend their situation and respond according to the surrounding environment, which facilitates survival in nature. With respect to virtual reality (VR) and augmented reality (AR), various types of wearable gear embedding sensors and actuators have been developed to provide stimulus from the virtual or augmented environment to users in the real world 1-3. To manipulate an object in VR and AR environments, a glove-type device is the most appropriate for the following reasons. A human hand has 27 degrees-of-freedom (DOFs), which is the highest number of DOFs among all body parts, thereby enabling the manipulation of objects with complicated forms. Moreover, according to the cortical homunculus of Penfield 4 , the hand, as an isolated part, is the most sensitive body part with different types of sensory receptors on the skin that enable us to feel multiple sensory modalities, including pressure, vibration, stretch, pain, and temperature. Furthermore, it is possible to perceive a wide range of stimuli ranging from light physical actions such as gentle touching to coarser actions such as pinching. To realize physical interaction with virtual objects, three major feedback displays have been employed in glove-type devices: tactile, haptic, and thermal 5. The tactile and haptic feedback displays employ micro motors and piezoelectric actuators, and they provide contact information by applying force and displacement to the mechanoreceptors in the skin of the hand. On the contrary, thermal feedback displays induce heat ...

show abstract

“…They found that with CGI of moving (dynamic) volumes, objects are perceived to be lighter. Visual stimuli can also affect perceived vibrotactile intensity [9]. Vibrations are perceived 'lighter' when visual cues suggest a larger or heavier object.…”

Section: Weightmentioning

confidence: 99%