Integration of Letters and Speech Sounds in the Human Brain

Atteveldt, Nienke van; Formisano, Elia; Goebel, Rainer; Blomert, Leo

doi:10.1016/j.neuron.2004.06.025

Cited by 474 publications

(529 citation statements)

References 47 publications

Supporting

Mentioning

459

Contrasting

Unclassified

Order By: Relevance

“…Previous studies have shown that posterior STS responds more to multisensory auditory-visual stimuli than to unisensory auditory or visual stimuli (Beauchamp et al, 2004b;Calvert, 2001;Hein et al, 2007;Noesselt et al, 2007;Raij et al, 2000;Van Atteveldt et al, 2004). Consistent with these results, we observed a larger response for multisensory auditory-tactile stimuli than unisensory auditory or tactile stimulation.…”

Section: Multisensory Integration In Stsmssupporting

confidence: 91%

“…That is, the response to auditory-tactile stimuli was greater than the response to auditory or tactile stimuli in isolation, but was not greater than the summed response to auditory and tactile unisensory stimuli (Stein and Meredith, 1993). Previous fMRI studies of auditory-visual integration in STS (Beauchamp et al, 2004a;Beauchamp et al, 2004b;Hein et al, 2007;Van Atteveldt et al, 2004;van Atteveldt et al, 2007) and auditory-tactile integration in auditory cortex (Kayser et al, 2005) have also not observed super-additive changes in the BOLD signal, perhaps because only a few single neurons show super-additivity (Laurienti et al, 2005;Perrault et al, 2005). Supporting this idea, in single-unit recording studies, only a small fraction of STP neurons respond to both auditory and tactile stimulation (Bruce et al, 1981;Hikosaka et al, 1988); the same is true in multisensory regions of cat cortex (Clemo et al, 2007).…”

Section: Multisensory Integration In Stsmsmentioning

confidence: 82%

“…In the banks of human posterior STS, neuroimaging studies have reported multisensory responses to auditory and visual stimulation (Beauchamp et al, 2004b;Calvert, 2001;Noesselt et al, 2007;Van Atteveldt et al, 2004;Wright et al, 2003). This region has been termed STSms, the STS multisensory region (Beauchamp et al, 2004a).…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Touch, sound and vision in human superior temporal sulcus

et al. 2008

View full text Add to dashboard Cite

Human superior temporal sulcus (STS) is thought to be a key brain area for multisensory integration. Many neuroimaging studies have reported integration of auditory and visual information in STS but less is known about the role of STS in integrating other sensory modalities. In macaque STS, the superior temporal polysensory area (STP) responds to somatosensory, auditory and visual stimulation. To determine if human STS contains a similar area, we measured brain responses to vibrotactile somatosensory, auditory and visual stimuli using blood-oxygen level dependent functional magnetic resonance imaging (BOLD fMRI). An area in human posterior STS, STSms (multisensory), responded to stimulation in all three modalities. STSms responded during both active and passive presentation of unisensory vibrotactile stimuli and showed larger responses for more intense vs. less intense tactile stimuli, hand vs. foot, and contralateral vs. ipsilateral tactile stimulation. STSms showed responses of similar magnitude for unisensory tactile and auditory stimulation, with an enhanced response to simultaneous auditory-tactile stimulation. We conclude that STSms is important for integrating information from the somatosensory as well as the auditory and visual modalities, and could be the human homolog of macaque STP.

show abstract

Section: Multisensory Integration In Stsmssupporting

confidence: 91%

Section: Multisensory Integration In Stsmsmentioning

confidence: 82%

See 1 more Smart Citation

Touch, sound and vision in human superior temporal sulcus

et al. 2008

View full text Add to dashboard Cite

show abstract

“…This holds also for bilateral STG activation (e.g., Early Phonological Activation in Visual Word Recognition Booth et al, 2002a;Tan et al, 2005). Activity in the STG was reported in response to individual speech sounds and letters (van Atteveldt et al, 2004) and to written and spoken narratives (Spitsyna et al, 2006) suggesting heteromodal processing and an involvement of the STG in cross-modal integration and multisensory convergence. Booth et al (2002a) also reported heteromodal STG activity for spoken words and visual rhyming.…”

Section: Early Phonological Activation In Visual Word Recognitionmentioning

confidence: 71%

Pseudohomophone effects provide evidence of early lexico‐phonological processing in visual word recognition

Braun¹,

Hutzler²,

Ziegler³

et al. 2008

Human Brain Mapping

View full text Add to dashboard Cite

Previous research using event-related brain potentials (ERPs) suggested that phonological processing in visual word recognition occurs rather late, typically after semantic or syntactic processing. Here we show that phonological activation in visual word recognition can be observed much earlier. Using a lexical decision task, we show that ERPs to pseudohomophones (e.g., ROZE) differed from well matched spelling controls (e.g., ROFE) as early as 150 ms (P150) after stimulus onset. The pseudohomophone effect occurred as early as the word frequency effect suggesting that phonological activation occurs early enough to influence lexical access. Low-resolution electromagnetic tomography analysis (LORETA) revealed that left temporo-parietal and right fronto-temporal areas are the likely brain regions associated with the processing of phonological information at the lexical level. Altogether, the results show that phonological processes are activated early in visual word recognition and play an important role in lexical access.

show abstract

“…However, due to the problems concerning motion and other artifacts associated with speaking in the scanner, only recently have fMRI studies used overt speech in fMRI [e.g., Barch et al, 2000;De Zubicaray et al, 2001;Kan and Thompson-Schill, 2004;Palmer et al, 2001;Shuster and Lemieux, 2005]. In this study, we used overt speech in combination with a clustered acquisition protocol [e.g., De Zubicaray, 2001;Jäncke et al, 2002;Van Atteveldt et al, 2004] for stimulus presentation and speech production to take place in the silent interval between scans. By avoiding scanning during speaking, a considerable reduction in motion-related artifacts is achieved [Birn et al, 2004;Gracco et al, 2005].…”

Section: Introductionmentioning

confidence: 99%

Neural correlates of verbal feedback processing: An fMRI study employing overt speech

Christoffels

Formisano

Schiller

2007

Human Brain Mapping

Self Cite

192

174

View full text Add to dashboard Cite

Speakers use external auditory feedback to monitor their own speech. Feedback distortion has been found to increase activity in the superior temporal areas. Using fMRI, the present study investigates the neural correlates of processing verbal feedback without distortion. In a blocked design, the following conditions were presented: (1) overt picture-naming, (2) overt picture-naming while pink noise was presented to mask external feedback, (3) covert picture-naming, (4) listening to the picture names (previously recorded from participants' own voices), and (5) listening to pink noise. The results show that auditory feedback processing involves a network of different areas related to general performance monitoring and speech-motor control. These include the cingulate cortex and the bilateral insula, supplementary motor area, bilateral motor areas, cerebellum, thalamus and basal ganglia. Our findings suggest that the anterior cingulate cortex, which is often implicated in error-processing and conflict-monitoring, is also engaged in ongoing speech monitoring. Furthermore, in the superior temporal gyrus, we found a reduced response to speaking under normal feedback conditions. This finding is interpreted in the framework of a forward model according to which, during speech production, the sensory consequence of the speech-motor act is predicted to attenuate the sensitivity of the auditory cortex. Hum Brain Mapp 28: [868][869][870][871][872][873][874][875][876][877][878][879] 2007. V V C 2007 Wiley-Liss, Inc.

show abstract

Integration of Letters and Speech Sounds in the Human Brain

Cited by 474 publications

References 47 publications

Touch, sound and vision in human superior temporal sulcus

Touch, sound and vision in human superior temporal sulcus

Pseudohomophone effects provide evidence of early lexico‐phonological processing in visual word recognition

Neural correlates of verbal feedback processing: An fMRI study employing overt speech

Contact Info

Product

Resources

About