Defining Auditory-Visual Objects: Behavioral Tests and Physiological Mechanisms

Bizley, Jennifer K.; Maddox, Ross K.; Lee, Adrian K. C.

doi:10.1016/j.tins.2015.12.007

Cited by 89 publications

(104 citation statements)

References 84 publications

(128 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recently, Stekelenburg et al (2013) and Roa Romero et al (2016b) also reported group differences in multisensory ERPs without showing effects in behavioral data. In an interesting framework on multisensory processing, Bizley et al (2016) suggested different stages of multisensory integration, in which the initial integrative processing can occur, at least partially, independent of later perception-related processing. In line with this proposal, the initial processing and integration could be disturbed in the SIFI trials in SCZ, whereas the later perceptual stages might be still intact.…”

Section: Discussionmentioning

confidence: 99%

Beta/Gamma Oscillations and Event-Related Potentials Indicate Aberrant Multisensory Processing in Schizophrenia

et al. 2016

View full text Add to dashboard Cite

Recent behavioral and neuroimaging studies have suggested multisensory processing deficits in patients with schizophrenia (SCZ). Thus far, the neural mechanisms underlying these deficits are not well understood. Previous studies with unisensory stimulation have shown altered neural oscillations in SCZ. As such, altered oscillations could contribute to aberrant multisensory processing in this patient group. To test this assumption, we conducted an electroencephalography (EEG) study in 15 SCZ and 15 control participants in whom we examined neural oscillations and event-related potentials (ERPs) in the sound-induced flash illusion (SIFI). In the SIFI multiple auditory stimuli that are presented alongside a single visual stimulus can induce the illusory percept of multiple visual stimuli. In SCZ and control participants we compared ERPs and neural oscillations between trials that induced an illusion and trials that did not induce an illusion. On the behavioral level, SCZ (55.7%) and control participants (55.4%) did not significantly differ in illusion rates. The analysis of ERPs revealed diminished amplitudes and altered multisensory processing in SCZ compared to controls around 135 ms after stimulus onset. Moreover, the analysis of neural oscillations revealed altered 25–35 Hz power after 100 to 150 ms over occipital scalp for SCZ compared to controls. Our findings extend previous observations of aberrant neural oscillations in unisensory perception paradigms. They suggest that altered ERPs and altered occipital beta/gamma band power reflect aberrant multisensory processing in SCZ.

show abstract

Section: Discussionmentioning

confidence: 99%

Beta/Gamma Oscillations and Event-Related Potentials Indicate Aberrant Multisensory Processing in Schizophrenia

et al. 2016

View full text Add to dashboard Cite

show abstract

“…On the other hand, the use of realistic stimuli under well-controlled conditions can provide an insight on the mechanisms of multisensory combination as they often occur. It also provides for a preservation of stimulus identity from a common audiovisual source, which promotes multisensory binding [45]. From this point of view it is equally arguable that realistic and congruent stimuli could be associated to higher levels of perceived common causality and integration than if more abstract stimuli were used.…”

Section: Discussionmentioning

confidence: 99%

Modeling the Perception of Audiovisual Distance: Bayesian Causal Inference and Other Models

2016

View full text Add to dashboard Cite

Studies of audiovisual perception of distance are rare. Here, visual and auditory cue interactions in distance are tested against several multisensory models, including a modified causal inference model. In this causal inference model predictions of estimate distributions are included. In our study, the audiovisual perception of distance was overall better explained by Bayesian causal inference than by other traditional models, such as sensory dominance and mandatory integration, and no interaction. Causal inference resolved with probability matching yielded the best fit to the data. Finally, we propose that sensory weights can also be estimated from causal inference. The analysis of the sensory weights allows us to obtain windows within which there is an interaction between the audiovisual stimuli. We find that the visual stimulus always contributes by more than 80% to the perception of visual distance. The visual stimulus also contributes by more than 50% to the perception of auditory distance, but only within a mobile window of interaction, which ranges from 1 to 4 m.

show abstract

“…There is also substantial evidence for integration of cross-modal signals later in the decisionmaking process. Whether correlates of multisensory evidence accumulation and decision-making are observed in sensory cortex as well as, or instead of, in higher areas may depend on the nature of the task and on whether multisensory signals are perceived as originating from a single perceptual object [5].…”

Section: Towards a Synthesismentioning

confidence: 99%

“…Integrating signals across sensory modalities can therefore reduce the inherent uncertainty within any sensory estimate and so improve performance in perceptual decisionmaking tasks. In the mammalian brain, the neural processes underlying decision-making [3,4] and multisensory integration [5][6][7] have become increasingly well understood but remain largely independent lines of investigation. In particular, it remains an open question at what point(s) in the decision-making process information is combined across modalities.…”

Section: Introductionmentioning

confidence: 99%

Where are multisensory signals combined for perceptual decision-making?

Bizley¹,

Jones²,

Town³

2016

Current Opinion in Neurobiology

View full text Add to dashboard Cite

Multisensory integration is observed in many subcortical and cortical locations including primary and non-primary sensory cortex, and higher cortical areas including frontal and parietal cortex. During unisensory perceptual tasks many of these same brain areas show neural signatures associated with decision-making. It is unclear whether multisensory representations in sensory cortex directly inform decision-making in a multisensory task, or if cross-modal signals are only combined after the accumulation of unisensory evidence at a final decision-making stage in higher cortical areas. Manipulations of neuronal activity are required to establish causal roles for given brain regions in multisensory perceptual decision-making, and so far indicate that distributed networks underlie multisensory decision-making. Understanding multisensory integration requires synthesis of small-scale pathway specific and large-scale network level manipulations.

show abstract

Defining Auditory-Visual Objects: Behavioral Tests and Physiological Mechanisms

Cited by 89 publications

References 84 publications

Beta/Gamma Oscillations and Event-Related Potentials Indicate Aberrant Multisensory Processing in Schizophrenia

Beta/Gamma Oscillations and Event-Related Potentials Indicate Aberrant Multisensory Processing in Schizophrenia

Modeling the Perception of Audiovisual Distance: Bayesian Causal Inference and Other Models

Where are multisensory signals combined for perceptual decision-making?

Contact Info

Product

Resources

About