The Ventriloquist Effect Results from Near-Optimal Bimodal Integration

Abstract

of the visual and auditory stimuli). The average position Precision of bimodal localization is usually better than of this stimulus was always zero, as in previous studies either the visual or the auditory unimodal presentation.[9]. On the other (non-conflict) presentation, the two All the results are well explained not by one sense modalities were covaried to the left or right of center by capturing the other, but by a simple model of optimal the amount shown in the abscissa (with positive meancombination of visual and auditory information. Figures 1B-1D show Results and Discussion results for ⌬ ϭ Ϯ5Њ, Ϯ2.5Њ, or 0Њ. The pattern of results depended critically on blob size, which increases Observers were required to localize in space brief light through (B)-(D). For small blob widths (4Њ; Figure 1B), "blobs" or sound "clicks," presented either separately the curves were displaced systematically in the direction (unimodally) or together (bimodally). In a given trial, two of ⌬ (to the side where the visual stimulus was dissets of stimuli were presented successively (separated placed), suggesting that vision dominated the perceived by a 500 ms pause) and observers were asked to indicate position of the incongruent stimuli (the ventriloquist efwhich appeared to be more to the left, guessing if unsure. fect). However, for large blobs (64Њ; Figure 1D), the reThe visual stimuli were low-contrast ( ing rightward). The different colored symbols in

Multisensory Integration of Low-level Information in Autism Spectrum Disorder: Measuring Susceptibility to the Flash-Beep Illusion

“…Vision has "higher spatial resolution" so it will dominate and alter the perception of sound on spatial tasks, but sound, which has a "higher temporal resolution", will alter the perception of other sensory modalities on tasks that are more temporal in nature (Welch and Warren 1980). However, more recent work suggests that a reliability-based framework of sensory integration may be more appropriate in describing auditory-visual multisensory effects (Alais and Burr 2004). According to this perspective, the sensory modality that provides the most reliable information in a given situation takes precedence over the other (Andersen et al 2004;Ernst and Banks 2002).…”

Encoding of event timing in the phase of neural oscillations

“…ventriloquism, (Alais and Burr, 2004;Lewald and Guski, 2003;Slutsky and Recanzone, 2001)) well accounted for by Bayesian models of multisensory integration (Alais and Burr, 2004;Burr and Alais, 2006;Ernst and Bülthoff, 2004;Witten and Knudsen, 2005). More generally, vision tends to be most reliable in encoding spatial cues whereas audition provides the most reliable temporal cues.…”

Predictive coding explains binocular rivalry: An epistemological review

“…If the prediction turns out to be right, and if the presence of a box is otherwise probable, then the probability for the hypothesis that it is a box goes up. If there are no better hypotheses in play, then this hypothesis wins and the perceptual inference will be that the environmental cause is indeed a box (These examples turn on visual perception; Bayesian frameworks are also often used in multisensory contexts, where one modality provides prior constraints for the other, e.g., Alais & Burr, 2004;Ernst & Banks, 2002).…”