Combined virtual reality and haptic robotics induce space and movement invariant sensorimotor adaptation

Wilf, Meytal; Cheraka, Mouna Cerra; Jeanneret, Max; Ott, Renaud; Perrin, Henri; Crottaz-Herbette, Sonia; Serino, Andrea

doi:10.1016/j.neuropsychologia.2020.107692

Cited by 15 publications

(26 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…3 ) 43 . This difference in mechanism occurs due to the nature of immersive-VR and was found in the previous studies on VPAT using HMD 27 , 29 , 30 . According to Redding and Wallace 14 realignment during PA occurs in an additive manner regarding visual and proprioceptive realignment, which is mainly responsible for after-effect from PA 13 .…”

Section: Discussionmentioning

confidence: 82%

“…Recently, studies have reported on applying immersive VR in PA. Gammeri et al 27 tested a PA system with gradual visual shift of a virtual rod in healthy participants, and demonstrated that the transfer effect was observed in the large shift group. Ramos et al 28 assessed the after-effect in VR using two different methods of inducing visual shift (visual rotation and visual skew) and discovered that PA using VR produces larger after-effect than conventional PA. Wilf et al 29 determined that PA using VR and passive adaptation training can induce after-effect. Conversely, Bourgeois et al 30 found no transfer effect when applying VR PA to neglect patients.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Feasibility study of immersive virtual prism adaptation therapy with depth-sensing camera using functional near-infrared spectroscopy in healthy adults

Cho

Chang

Park

et al. 2022

Sci Rep

View full text Add to dashboard Cite

Prism Adaptation (PA) is used to alleviate spatial neglect. We combined immersive virtual reality with a depth-sensing camera to develop virtual prism adaptation therapy (VPAT), which block external visual cues and easily quantify and monitor errors than conventional PA. We conducted a feasibility study to investigate whether VPAT can induce behavioral adaptations by measuring after-effect and identifying which cortical areas were most significantly activated during VPAT using functional near-infrared spectroscopy (fNIRS). Fourteen healthy subjects participated in this study. The experiment consisted of four sequential phases (pre-VPAT, VPAT-10°, VPAT-20°, and post-VPAT). To compare the most significantly activated cortical areas during pointing in different phases against pointing during the pre-VPAT phase, we analyzed changes in oxyhemoglobin concentration using fNIRS during pointing. The pointing errors of the virtual hand deviated to the right-side during early pointing blocks in the VPAT-10° and VPAT-20° phases. There was a left-side deviation of the real hand to the target in the post-VPAT phase, demonstrating after-effect. The most significantly activated channels during pointing tasks were located in the right hemisphere, and possible corresponding cortical areas included the dorsolateral prefrontal cortex and frontal eye field. In conclusion, VPAT may induce behavioral adaptation with modulation of the dorsal attentional network.

show abstract

Section: Discussionmentioning

confidence: 82%

Section: Introductionmentioning

confidence: 99%

Feasibility study of immersive virtual prism adaptation therapy with depth-sensing camera using functional near-infrared spectroscopy in healthy adults

Cho

Chang

Park

et al. 2022

Sci Rep

View full text Add to dashboard Cite

show abstract

“…Importantly, the participants’ virtual hand was invisible while the hand was within the radius of the round table (~30 cm from the origin position), and became visible only in the last segment of the reaching movement trajectory, namely when the hand was already close to the target. This partial visual feedback of hand trajectory enables both strategic and online mechanisms to take place during adaptation (Facchin et al ., 2020; Wilf et al ., 2020). In each trial, the tennis ball approached the participant at a constant speed randomly selected within the range of comfortable ball speeds.…”

Section: Methodsmentioning

confidence: 99%

“…Hence, the VR setup have enabled us to tap into sensorimotor mechanisms that are more ecological than during standard PA (reaching to dynamic objects), thus potentially resulting in better transfer to real-life behaviour (Fortis et al, 2010;Champod et al, 2018). Though the adaptation shift was implemented using visuomotor rotation (cf., Krakauer, 2009;Gammeri et al, 2018), the fact that the feedback from the hand position was limited only to the last part of the movement (where the lateral shift was already close to its maximum size) promotes explicit adaptation mechanisms (Taylor et al, 2014), resembling the classic PA (Wilf et al, 2020).…”

Section: Leftward Spatial Bias -Shift In Reference Framesmentioning

confidence: 99%

“…The radius for catching the targets was limited to a minimum of 30 cm in order to force the participants to perform large and quick reaching movements that enable proper adaptation, and to prevent the ball from arriving too close to the participant's body. During the VRPA session, a rightward/leftward 20° rotational shift was induced between the real hand and the virtual hand (see Figure 1a) on the 11 th trial (similarly to Wilf et al, 2020)). During baseline and sham-VRPA sessions, the virtual hand and the real hand were always aligned.…”

Section: Vrpa Trainingmentioning

confidence: 99%

See 1 more Smart Citation

Virtual reality-based sensorimotor adaptation shapes subsequent spontaneous and naturalistic stimulus-driven brain activity

Wilf

Dupuis²,

Nardo

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

Our everyday life summons numerous novel sensorimotor experiences, to which our brain needs to adapt in order to function properly. However, tracking plasticity of naturalistic behaviour and associated brain modulations is challenging. Here we tackled this question implementing a prism adaptation training in virtual reality (VRPA) in combination with functional neuroimaging. Three groups of healthy participants (N=45) underwent VRPA (with a spatial shift either to the left/right side, or with no shift), and performed fMRI sessions before and after training. To capture modulations in free-flowing, task-free brain activity, the fMRI sessions included resting state and free viewing of naturalistic videos. We found significant decreases in spontaneous functional connectivity between large-scale cortical networks, namely attentional and default mode/fronto-parietal networks, only for adaptation groups. Additionally, VRPA was found to bias visual representations of naturalistic videos, as following rightward adaptation, we found upregulation of visual response in an area in the parieto-occipital sulcus (POS) in the right hemisphere. Notably, the extent of POS upregulation correlated with the size of the VRPA induced after-effect measured in behavioural tests. This study demonstrates that a brief VRPA exposure is able to change large-scale cortical connectivity and correspondingly bias the representation of naturalistic sensory inputs.

show abstract

Sensorimotor adaptation in virtual reality: Do instructions and body representation influence aftereffects?

Wähnert,

Schäfer

2024

Virtual Reality

View full text Add to dashboard Cite

Perturbations in virtual reality (VR) lead to sensorimotor adaptation during exposure, but also to aftereffects once the perturbation is no longer present. An experiment was conducted to investigate the impact of different task instructions and body representation on the magnitude and the persistence of these aftereffects. Participants completed the paradigm of sensorimotor adaptation in VR. They were assigned to one of three groups: control group, misinformation group or arrow group. The misinformation group and the arrow group were each compared to the control group to examine the effects of instruction and body representation. The misinformation group was given the incorrect instruction that in addition to the perturbation, a random error component was also built into the movement. The arrow group was presented a virtual arrow instead of a virtual hand. It was hypothesised that both would lead to a lower magnitude and persistence of the aftereffect because the object identity between hand and virtual representation would be reduced, and errors would be more strongly attributed to external causes. Misinformation led to lower persistence, while the arrow group showed no significant differences compared to the control group. The results suggest that information about the accuracy of the VR system can influence the aftereffects, which should be considered when developing VR instructions. No effects of body representation were found. One possible explanation is that the manipulated difference between abstract and realistic body representation was too small in terms of object identity.

show abstract

Combined virtual reality and haptic robotics induce space and movement invariant sensorimotor adaptation

Cited by 15 publications

References 65 publications

Feasibility study of immersive virtual prism adaptation therapy with depth-sensing camera using functional near-infrared spectroscopy in healthy adults

Feasibility study of immersive virtual prism adaptation therapy with depth-sensing camera using functional near-infrared spectroscopy in healthy adults

Virtual reality-based sensorimotor adaptation shapes subsequent spontaneous and naturalistic stimulus-driven brain activity

Sensorimotor adaptation in virtual reality: Do instructions and body representation influence aftereffects?

Contact Info

Product

Resources

About