Primary and multisensory cortical activity is correlated with audiovisual percepts

Benoit, Margo McKenna; Raij, Tommi; Lin, Fa‐Hsuan; Jä̈askëlainen, Iiro P.; Stufflebeam, Steven M.

doi:10.1002/hbm.20884

Cited by 76 publications

(82 citation statements)

References 88 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Stronger activity for sine-wave speech (when perceived as speech) has been observed in the superior temporal gyrus [183] and superior temporal sulcus [184], consistent with these areas' involvement in speech processing [185][186][187]. For the McGurk effect, functional imaging studies indicate that it is also reflected by activity in AC [188][189][190]. For example, when 'va' was used as standard and 'ba' as a deviant, no MMN was evoked when 'ba' was perceived as 'va' because of the video [188].…”

Section: (D) Auditory Invariances and Context Effectsmentioning

confidence: 64%

A roadmap for the study of conscious audition and its neural basis

Dykstra

Cariani

Gutschalk

2017

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

One contribution of 15 to a theme issue 'Auditory and visual scene analysis'. Subject Areas: cognition, neuroscience, behaviourKeywords: audition, auditory scene analysis, conscious perception, neural correlates of consciousness, perceptual awareness Author for correspondence: Andrew R. Dykstra e-mail: andrew.dykstra@med.uni-heidelberg.de A roadmap for the study of conscious audition and its neural basis Andrew R. Dykstra 1 , Peter A. Cariani 2 and Alexander Gutschalk 1 1 Department of Neurology, Ruprecht-Karls-Universität Heidelberg, Heidelberg, Germany 2 Hearing Research Center, Boston University, Boston, MA, USA ARD, 0000-0001-8075-6374How and which aspects of neural activity give rise to subjective perceptual experience-i.e. conscious perception-is a fundamental question of neuroscience. To date, the vast majority of work concerning this question has come from vision, raising the issue of generalizability of prominent resulting theories. However, recent work has begun to shed light on the neural processes subserving conscious perception in other modalities, particularly audition. Here, we outline a roadmap for the future study of conscious auditory perception and its neural basis, paying particular attention to how conscious perception emerges (and of which elements or groups of elements) in complex auditory scenes. We begin by discussing the functional role of the auditory system, particularly as it pertains to conscious perception. Next, we ask: what are the phenomena that need to be explained by a theory of conscious auditory perception? After surveying the available literature for candidate neural correlates, we end by considering the implications that such results have for a general theory of conscious perception as well as prominent outstanding questions and what approaches/techniques can best be used to address them.This article is part of the themed issue 'Auditory and visual scene analysis'. IntroductionHow subjective perceptual experience-i.e. conscious perception-emerges from patterns of brain activity is a fundamental question of modern neuroscience. Although relationships between neural activity and conscious perception have been pondered since the beginning of the mind-brain sciences [1][2][3][4][5][6], many have viewed the problem as scientifically intractable. However, employing increasingly powerful methods [7], recent years have seen a dramatic increase in studies pursuing the so-called neural correlates of consciousness, or NCC [8], defined as the 'the minimal set of neural events jointly sufficient for a specific conscious experience' [9] (e.g. the phenomenal experience of hearing a sound). This definition, in contrast with others that distinguish between the NCC and the NCCC (neural correlates of the contents of consciousness), subsumes both the 'preconditions' and content-specific processes associated with specific conscious percepts [10], acknowledging that all conscious experiences have content (though varying in richness [11,12], an idea also underscored by early auditory selective-a...

show abstract

Section: (D) Auditory Invariances and Context Effectsmentioning

confidence: 64%

A roadmap for the study of conscious audition and its neural basis

Dykstra

Cariani

Gutschalk

2017

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

show abstract

“…Cross-modal binding was associated with activations in the AIC bilaterally, among other regions in dorsolateral prefrontal cortex, superior parietal cortex and the superior colliculi. A different finding was reported by the above-mentioned recent study that used the McGurk effect to study cross-modal binding (Benoit et al 2009). While mismatching auditory-visual input was associated with increased fMRI signal in the AIC, this signal correlated negatively across participants with the degree of McGurk fusion, i.e., the proportion of trials where auditory perception was overruled by visual information.…”

Section: Cross-modal Interactionsmentioning

confidence: 74%

“…Similar to the study by Bushara et al (2001), these regions showed greater responses during asynchronous stimulus presentation. The AIC is also activated during other types of auditory-visual mismatch, e.g., when the consonants in auditory speech stimuli do not match with those shown in visual stimuli as in the so-called McGurk effect (McGurk and MacDonald 1976;Benoit et al 2009). …”

Section: Cross-modal Interactionsmentioning

confidence: 99%

“…The fact that insular cortex is highly connected to all sensory cortices certainly speaks of the notion that it plays a key role in assigning processing resources to those sensory stimuli that are currently most relevant according to stimulus-or task-related criteria. Again, AIC activations in cross-modal studies can be attributed to task demands (Bushara et al 2001) or to perceived stimulus salience, which may be the key factor in mismatch-related responses (Bushara et al 2001;Benoit et al 2009). But why should the AIC show stronger activations in cross-modal binding as reported by Bushara et al (2003)?…”

Section: Cross-modal Interactionsmentioning

confidence: 99%

See 1 more Smart Citation

Anterior insula activations in perceptual paradigms: often observed but barely understood

2010

View full text Add to dashboard Cite

Anterior insular cortex is among the non-sensory brain regions most commonly found activated in functional brain imaging studies on visual and auditory perception. However, most of these studies do not explicitly address the functional role of this specific brain region in perception, but rather report its activation as a by-product. Here, we attempt to characterize the involvement of anterior insular cortex in various perceptual paradigms, including studies of visual awareness, perceptual decision making, cross-modal sensory processes and the role of spontaneous neural activity fluctuations in perception. We conclude that anterior insular cortex may be associated with perception in that it underpins heightened alertness of either stimulus- or task-driven origin, or both. Such a mechanism could integrate endogenous and exogenous functional demands under the joint criterion of whether they challenge an individual's homeostasis.

show abstract

“…In some previous studies, as in the case presented herein, the bilateral pSTS particularly failed to respond to congruency manipulation (Bushara et al, 2001;Miller and D'Esposito, 2005;Ojanen et al, 2005). In addition, other studies found a higher BOLD response to the incongruent condition vs. the congruent condition (Benoit et al,2010 ;Pekkola et al, 2006), or vice versa (Calvert et al, 2000;van Atteveldt et al, 2004;van Atteveldt et al, 2009; note that Calvert et al found only left pSTS activation). Therefore, the responsiveness of the bilateral pSTS to congruency remains unclear.…”

Section: Congruency Effectsmentioning

confidence: 92%

Neural correlates of audiovisual speech processing in a second language

et al. 2013

View full text Add to dashboard Cite

Abbreviations: L1 = native language, L2 = non-native language, pSTS = posterior superior temporal sulcus, STG = superior temporal gyrus, AV = audiovisual, AVc = audiovisual congruent, AVi = audiovisual incongruent, A = auditory, V = visual, B = baseline, MSI = multisensory interaction 2 AbstractNeuroimaging studies of audiovisual speech processing have exclusively addressed listeners' native language (L1). Yet, several behavioural studies now show that AV processing plays an important role in non-native (L2) speech perception. The current fMRI study measured brain activity during auditory, visual, audiovisual congruent and audiovisual incongruent utterances in L1 and L2. BOLD responses to congruent AV speech in the pSTS were stronger than in either unimodal condition in both L1 and L2. Yet no differences in AV processing were expressed according to the language background in this area. Instead, the regions in the bilateral occipital lobe had a stronger congruency effect on the BOLD response (congruent higher than incongruent) in L2 as compared to L1. According to these results, language background differences are predominantly expressed in these unimodal regions, whereas the pSTS is similarly involved in AV integration regardless of language dominance.

show abstract

Primary and multisensory cortical activity is correlated with audiovisual percepts

Cited by 76 publications

References 88 publications

A roadmap for the study of conscious audition and its neural basis

A roadmap for the study of conscious audition and its neural basis

Anterior insula activations in perceptual paradigms: often observed but barely understood

Neural correlates of audiovisual speech processing in a second language

Contact Info

Product

Resources

About