The Neurophysiological Basis of the Trial-Wise and Cumulative Ventriloquism Aftereffects

Park, Hame; Kayser, Christoph

doi:10.1523/jneurosci.2091-20.2020

Cited by 28 publications

(48 citation statements)

References 68 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We hence directly compared the magnitude of the aftereffect biases obtained here to data obtained in similar versions of this task in our previous work. To this end we reanalysed the data from a previous EEG study (Park & Kayser, 2021) (n=19), a study manipulating time delays in between trials (n=41) or introducing a mask between AV and A trials (n=44)(Park & Kayser, 2020) and a dataset obtained in a study comparing young and older participants (n=22; younger participants only) (Park et al, 2021). These paradigms differed in their number (using 9, 5, 9 and 9 levels respectively) or range of spatial discrepancies used (34°, 24°, 32° and 32°).…”

Section: Resultsmentioning

confidence: 99%

“…This finding has interesting implications for the discussion of computational underpinnings of the aftereffect. Previous experiments have shown that the aftereffect can emerge independently on an immediate (trial-by-trial) scale and over cumulative long-term exposure (Bruns & Röder, 2015, 2019; Park & Kayser, 2021; Wozny & Shams, 2011b). Previous work has speculated that the immediate aftereffect may be directly related to the integration in the preceding trial, whereby the (implicit) judgement about a putative causal relation between two sensory cues moulds the recalibration process (Badde et al, 2020; Bruns & Röder, 2015; Noppeney, 2021; Park & Kayser, 2019; Rohlf et al, 2021).…”

Section: Discussionmentioning

confidence: 99%

“…31 healthy right-handed adults (10 males, mean age 25.5 years, range 19 - 37 years) participated in this study. Following previous studies using similar experimental protocols (Park et al, 2021; Park & Kayser, 2020, 2021) and recommendations for sample sizes in empirical psychology (Simmons et al, 2011) we aimed for a sample size of at least n=20. Of the 31 recruited participants, three had to be excluded as they did not follow the task instructions (localizing the visual rather than the auditory target in AV trials) and two exhibited a below-threshold spatial localization performance during a screening task (see below).…”

Section: Methodsmentioning

confidence: 99%

“…Visual stimuli were projected (Acer Predator Z650, Acer Inc., New Taipei City, Taiwan) onto an acoustically transparent screen placed in front of the speakers (Screen International Modigliani, 2×1 m 2 ). The visual stimulus was a cloud of white dots distributed according to a two-dimensional Gaussian distribution (200 dots, SD of vertical and horizontal spread = 1.6°, width of a single dot = 0.12°, duration = 50 ms), which has been used in previous studies on the ventriloquism effect and aftereffect (Park et al, 2021; Park & Kayser, 2020, 2021). The visual stimuli were centred around the same five locations as the acoustic stimuli (Figure 1B).…”

Section: Methodsmentioning

confidence: 99%

“…To study the context sensitivity of multisensory judgements we focused on an audio-visual spatial ventriloquism paradigm, which has proven to be a valuable window onto the computational and neural underpinnings of multisensory perception (Park & Kayser, 2019, 2021; Rohe & Noppeney, 2015a, 2016). Across two sessions, we presented audio-visual stimuli in two spatial contexts: one in which these stimuli covered a wide range of spatial discrepancies (between ± 46°) and one in which they covered only a narrower range (between ± 26°), while keeping the number of potential stimulus locations the same across contexts.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

The context of experienced sensory discrepancies shapes multisensory integration and recalibration differently

Park

Kayser

2021

Preprint

Self Cite

View full text Add to dashboard Cite

Whether two sensory cues interact during perceptual judgments depends on their immediate properties, but as suggested by Bayesian models, also on the observer's a priori belief that these originate from a common source. While in many experiments this a priori belief is considered fixed, in real life it must adapt to the momentary context or environment. To understand the adaptive nature of human multisensory perception we investigated the context-sensitivity of spatial judgements in a ventriloquism paradigm. We exposed observers to audio-visual stimuli whose discrepancy either varied over a wider (±46°) or a narrower range (±26°) and hypothesized that exposure to a wider range of discrepancies would facilitate multisensory binding by increasing participants a priori belief about a common source for a given discrepancy. Our data support this hypothesis by revealing an enhanced integration (ventriloquism) bias in the wider context, which was echoed in Bayesian causal inference models fit to participants' data, which assigned a stronger a priori integration tendency during the wider context. Interestingly, the immediate ventriloquism aftereffect, a multisensory response bias obtained following a multisensory test trial, was not affected by the contextual manipulation, although participants' confidence in their spatial judgments differed between contexts for both integration and recalibration trials. These results highlight the context-sensitivity of multisensory binding and suggest that the immediate ventriloquism aftereffect is not a purely sensory-level consequence of the multisensory integration process.

show abstract

Section: Resultsmentioning

confidence: 99%