Multisensory Integration Develops Prior to Crossmodal Recalibration

Abstract

Highlights d Multisensory integration develops prior to unsupervised crossmodal recalibration d Multisensory integration and crossmodal learning are dissociable processes d Crossmodal recalibration in humans emerges first for short timescales d Crossmodal recalibration requiring accumulation of evidence develops last

The neurophysiological basis of short- and long-term ventriloquism aftereffects

“…Our data also show that the sequential accumulation of bias evident at the level of behavior is specific to the aftereffect, while the ventriloquism bias itself remains stable, even following long-term exposure ( Figure 1C, S2B). The ventriloquism aftereffect has been considered a direct consequence of the ventriloquism effect, by which the discrepant audio-visual information is combined into a biased perceived location of the multisensory stimulus (Lewald 2002;Bertelson 1977, 1978;Recanzone 1998Recanzone , 2009Rohlf et al 2020). This is corroborated by the significant trial-by-trial correlation of both biases in both paradigms ( Figure S2).…”

“…Despite the importance of such adaptive multisensory processes in everyday life, their neural underpinnings remain unclear. Our environment changes on multiple timescales and not surprisingly, perceptual recalibration emerges also on distinct scales (Bosen et al 2017(Bosen et al , 2018Röder 2015, 2019;Rohlf et al 2020;Van der Burg, Alais, and Cass 2015). During the ventriloquism aftereffect (Bruns and Röder 2015;Canon 1970;Radeau and Bertelson 1974;Recanzone 1998;Wozny and Shams 2011) the exposure to displaced acoustic and visual stimuli reliably biases the perceived location of subsequent unisensory sounds (Frissen, Vroomen, and de Gelder 2012;Mendonça et al 2015;Watson et al 2019;Woods and Recanzone 2004).…”

The Neurophysiological Basis of the Trial-Wise and Cumulative Ventriloquism Aftereffects

“…Despite the importance of such adaptive multisensory processes in everyday life, their neural underpinnings remain unclear. Our environment changes on multiple timescales and not surprisingly, perceptual recalibration emerges also on distinct scales (Bosen et al, 2017(Bosen et al, , 2018Bruns & Röder, 2015Rohlf et al, 2020;Van der Burg et al, 2015). During the ventriloquism aftereffect (Bruns & Röder, 2015;Canon, 1970;Radeau & Bertelson, 1974;Recanzone, 1998;Wozny & Shams, 2011) the exposure to displaced acoustic and visual stimuli in an audio-visual trial reliably biases the perceived location of subsequent sounds received during an unisensory trial (Frissen et al, 2012;Mendonça et al, 2015;Watson et al, 2019;Woods & Recanzone, 2004).…”

The Size-Weight Illusion is unimpaired in individuals with a history of congenital visual deprivation

“…These models weight individual cues according to their relative reliability to derive a multisensory outcome. It has more recently been demonstrated that in situations where it is ambiguous whether or not to integrate sensory information, the data from children as young as 5 years of age, like those of adults, are better explained by causal inference models (Rohlf, Li, Bruns, & Röder, 2020). Given that some (n=4) of our CC participants had been older than 10 years of age at the time of surgery, our results suggest that patterned vision during this period of multisensory development was not crucial for the typical manifestation of the SWI with either visuo-haptic or only visual size information.…”