Perception of Speech in Noise: Neural Correlates

Song, Judy H.; Skoe, Erika; Banai, Karen; Kraus, Nina

doi:10.1162/jocn.2010.21556

Cited by 184 publications

(187 citation statements)

References 84 publications

Supporting

Mentioning

169

Contrasting

Unclassified

Order By: Relevance

“…The reduced convergence exhibited when shadowing speech presented in auditory noise is consistent with findings in which speech identifiability has been reduced when identifying speech presented in auditory noise (e.g., G. A. Miller et al, 1951;Song, Skoe, Banai, & Kraus, 2011). The results are also consistent with findings illustrating reduced talker facilitation of speech perception when identifying speech in noise (e.g., Mullennix et al, 1989).…”

Section: Visual Enhancement and Noise Effects On Phonetic Convergencesupporting

confidence: 87%

Visibility of speech articulation enhances auditory phonetic convergence

Dias

Rosenblum

2015

Atten Percept Psychophys

View full text Add to dashboard Cite

Talkers automatically imitate aspects of perceived speech, a phenomenon known as phonetic convergence. Talkers have previously been found to converge to auditory and visual speech information. Furthermore, talkers converge more to the speech of a conversational partner who is seen and heard, relative to one who is just heard (Dias & Rosenblum Perception, 40, 1457-1466, 2011. A question raised by this finding is what visual information facilitates the enhancement effect. In the following experiments, we investigated the possible contributions of visible speech articulation to visual enhancement of phonetic convergence within the noninteractive context of a shadowing task. In Experiment 1, we examined the influence of the visibility of a talker on phonetic convergence when shadowing auditory speech either in the clear or in low-level auditory noise. The results suggest that visual speech can compensate for convergence that is reduced by auditory noise masking. Experiment 2 further established the visibility of articulatory mouth movements as being important to the visual enhancement of phonetic convergence. Furthermore, the word frequency and phonological neighborhood density characteristics of the words shadowed were found to significantly predict phonetic convergence in both experiments. Consistent with previous findings (e.g., Goldinger Psychological Review, 105, 251-279, 1998), phonetic convergence was greater when shadowing low-frequency words. Convergence was also found to be greater for low-density words, contrasting with previous predictions of the effect of phonological neighborhood density on auditory phonetic convergence (e.g., Pardo, Jordan, Mallari, Scanlon, & Lewandowski Journal of Memory and Language, 69, 183-195, 2013). Implications of the results for a gestural account of phonetic convergence are discussed.

show abstract

Section: Visual Enhancement and Noise Effects On Phonetic Convergencesupporting

confidence: 87%

Visibility of speech articulation enhances auditory phonetic convergence

Dias

Rosenblum

2015

Atten Percept Psychophys

View full text Add to dashboard Cite

show abstract

“…Specifically, we predicted that the fundamental frequency (F0) of the syllable, a feature that underlies pitch perception, facilitates grouping of auditory objects, is robustly represented in the cABR, and is sensitive to experience and perceptual abilities (34)(35)(36), would demonstrate the strongest bilingual advantage.…”

mentioning

confidence: 99%

Subcortical encoding of sound is enhanced in bilinguals and relates to executive function advantages

Krizman

Marian

Shook

et al. 2012

Proc. Natl. Acad. Sci. U.S.A.

Self Cite

254

226

View full text Add to dashboard Cite

Bilingualism profoundly affects the brain, yielding functional and structural changes in cortical regions dedicated to language processing and executive function [Crinion J, et al. (2006) Science 312:1537–1540; Kim KHS, et al. (1997) Nature 388:171–174]. Comparatively, musical training, another type of sensory enrichment, translates to expertise in cognitive processing and refined biological processing of sound in both cortical and subcortical structures. Therefore, we asked whether bilingualism can also promote experience-dependent plasticity in subcortical auditory processing. We found that adolescent bilinguals, listening to the speech syllable [da], encoded the stimulus more robustly than age-matched monolinguals. Specifically, bilinguals showed enhanced encoding of the fundamental frequency, a feature known to underlie pitch perception and grouping of auditory objects. This enhancement was associated with executive function advantages. Thus, through experience-related tuning of attention, the bilingual auditory system becomes highly efficient in automatically processing sound. This study provides biological evidence for system-wide neural plasticity in auditory experts that facilitates a tight coupling of sensory and cognitive functions.

show abstract

“…67 Both children and young adults who have greater F 0 magnitudes in their cABRs also have better SIN perception. 68 19 This difference in F 0 encoding was seen in the transition but not the in steady-state region of the response. The formant transition carries phonetic information 70 and its perception can easily be disrupted by noise.…”

Section: Pitch Representationmentioning

confidence: 86%

Neural Encoding of Speech and Music: Implications for Hearing Speech in Noise

Anderson¹,

Kraus

2012

Semin Hear

Self Cite

View full text Add to dashboard Cite

Understanding speech in a background of competing noise is challenging, especially for individuals with hearing loss or deficits in auditory processing ability. The ability to hear in background noise cannot be predicted from the audiogram, an assessment of peripheral hearing ability; therefore, it is important to consider the impact of central and cognitive factors on speechin-noise perception. Auditory processing in complex environments is reflected in neural encoding of pitch, timing, and timbre, the crucial elements of speech and music. Musical expertise in processing pitch, timing, and timbre may transfer to enhancements in speech-in-noise perception due to shared neural pathways for speech and music. Through cognitive-sensory interactions, musicians develop skills enabling them to selectively listen to relevant signals embedded in a network of melodies and harmonies, and this experience leads in turn to enhanced ability to focus on one voice in a background of other voices. Here we review recent work examining the biological mechanisms of speech and music perception and the potential for musical experience to ameliorate speech-in-noise listening difficulties. KeywordsBrain stem; music; speech in noise; timing; pitch From busy classrooms to crowded restaurants, our world is a noisy place. To participate fully in today's society, we must selectively attend and listen to one voice among competing voices and other noises. Listening in noise is particularly challenging for clinical populations, such as children with learning impairments (i.e., dyslexia, autism spectrum disorder, attention deficit disorder, auditory processing disorder, specific language impairment) 1-8 and older adults with and without hearing loss. [9][10][11][12][13] The problem with hearing in noise is often not an issue of audibility-the individual can hear but cannot To understand the message, the individual must process the three basic components of sound: pitch, timing, and timbre. Processing these elements is important for understanding both speech and music, and the musician's ability to tune into music (along with enhanced working memory and attention) appears to transfer to the ability to tune into speech in background noise. Music is said to be biologically powerful, 14,15 with effects of musical training on neural functions lasting for a lifetime. The auditory system is malleable and adaptive, making constant changes based on immediate sensory and behavioral contexts and past experiences, including musical training. 16 In this review, we summarize recent work examining the neural mechanisms of speech-in-noise (SIN) perception, including encoding of stimulus regularities, timing, and pitch, and the effects of musical experience on the neural encoding of speech, particularly in noise. SUBCORTICAL APPROACH TO EXAMINING NEURAL SOUND ENCODINGThe use of auditory brain stem responses to study the neural encoding of speech and music has been fruitful for several reasons. Unlike the cortical response, the brain stem response to comp...

show abstract

Perception of Speech in Noise: Neural Correlates

Cited by 184 publications

References 84 publications

Visibility of speech articulation enhances auditory phonetic convergence

Visibility of speech articulation enhances auditory phonetic convergence

Subcortical encoding of sound is enhanced in bilinguals and relates to executive function advantages

Neural Encoding of Speech and Music: Implications for Hearing Speech in Noise

Contact Info

Product

Resources

About