Visual Cues and Listening Effort: Individual Variability

Picou, Erin M.; Ricketts, Todd A.; Hornsby, Benjamin W. Y.

doi:10.1044/1092-4388(2011/10-0154)

Cited by 101 publications

(134 citation statements)

References 73 publications

Supporting

Mentioning

118

Contrasting

Unclassified

Order By: Relevance

“…Further, the older adults had lower reading span scores than young adults, indicating that they had lower WMC. Thus, the finding of greater benefit of visual cues by young adults is in line with that of Picou et al (2011) who found that only persons with high WMC derived benefit from the presence of visual cues. This pattern of findings suggest that when executive processing demands are high, as found in the CSCT, visual cues compensate for the reduction in CSC attributable to noise.…”

Section: Reanalysissupporting

confidence: 86%

“…Furthermore, older adults also showed decreased neural activation with visual cues, indicating a processing benefit in terms of less cognitive resources used in the presence of visual cues. Picou et al (2011) found that the person with low WMC did not derive any benefit from the presence of visual cues whereas person with high WMC did derive benefit from the presence of visual cues in cued recall of words. Sommers, Tye-Murray and Spehar (2005) found that the AV integration for speech perception in noise was similar across young and older adults with normal hearing, but the young adults had better speech reading skills compared to older adults and hence had better performance in the AV modality.…”

Section: Visual Cuesmentioning

confidence: 88%

“…It has been established that cognitive resources are often recruited to fill in the missing information due to hearing loss or signal degradation including the use of hearing aids implementing signal processing (Rönnberg 2003;Stenfelt & Rönnberg, 2009;Rönnberg et al, 2013). However, this comes at the cost of reduced cognitive resources, which is demonstrated as higher listening effort or fatigue (Edward, 2007;Picou, Ricketts & Hornsby, 2011). Recently, listening effort has been defined in cognitive terms, where it has been defined as the cognitive resources that are consumed for speech recognition (Picou, et al 2011;Fraser, Gagné, Alepins & Dubois, 2010).…”

Section: Hearing Aidsmentioning

confidence: 99%

“…However, this comes at the cost of reduced cognitive resources, which is demonstrated as higher listening effort or fatigue (Edward, 2007;Picou, Ricketts & Hornsby, 2011). Recently, listening effort has been defined in cognitive terms, where it has been defined as the cognitive resources that are consumed for speech recognition (Picou, et al 2011;Fraser, Gagné, Alepins & Dubois, 2010). From this definition it can be assumed that listening effort will be more pronounced when CSC for the individuals is reduced.…”

Section: Hearing Aidsmentioning

confidence: 99%

“…Such information about the particular cognitive processes involved in speech understanding and remaining cognitive resources in CSC may help towards developing a theoretical understanding of CSC. In addition, in most of the studies assessing memory performance or listening effort involved in speech understanding, the modality of presentation is in the A-only modality (except for the study by Picou, et al 2011), while communication in real situation is often multimodal.…”

Section: Agingmentioning

confidence: 99%

See 4 more Smart Citations

Exploring Cognitive Spare Capacity : Executive Processing of Degraded Speech

Mishra¹

2014

View full text Add to dashboard Cite

Cognitive resources, specifically working memory capacity are used for listening to speech, especially in noise. Cognitive resources are limited, and if listeners allocate a greater share of these resources to recovering the input signal in noise, fewer resources are available for interpreting and encoding its linguistic content. Although the importance of CSC for individual success in communicative situations has been acknowledged, this concept has not hitherto been explored experimentally. In this thesis, a CSC test (CSCT) was developed and administered to young adults with normal hearing and older adults with age-related hearing loss. CSCT required executive processing of speech at different memory loads with and without visual cues in different noise conditions. A free recall task using the same material was administered for comparison purposes and a battery of cognitive tests was administered to understand the relation between CSC and established cognitive concepts. The aims of the thesis were to investigate how CSC is influenced by 1) different executive demands and memory loads; 2) background noise; 3) visual cues; 4) aging and concomitant hearing loss. The results showed that 1) CSC was sensitive to memory load, and updating demands reduced CSC more than inhibition demands; 2) CSC was reduced in background noise compared to quiet; 3) visual cues enhanced CSC especially in noise; 4) CSC was reduced with ageing and concomitant hearing loss especially when visual cues were absent, memory demands were increased and background noise was speech-like. The main finding of this thesis was that visual cues enhanced CSC for older individuals with hearing loss, specifically in adverse listening conditions. This demonstrates the importance of audiovisual testing in audiological assessment. Further, specific cognitive resources depleted during listening in noise were at least partially compensated by other cognitive functions. This thesis is the first step towards a theoretical understanding of CSC and in future, tests of CSC may play a crucial role in planning rehabilitation of persons with hearing loss.

show abstract

Section: Reanalysissupporting

confidence: 86%

Section: Visual Cuesmentioning

confidence: 88%

Section: Hearing Aidsmentioning

confidence: 99%

Section: Hearing Aidsmentioning

confidence: 99%

Section: Agingmentioning

confidence: 99%

See 3 more Smart Citations

Exploring Cognitive Spare Capacity : Executive Processing of Degraded Speech

Mishra¹

2014

View full text Add to dashboard Cite

show abstract

Listening effort: Are we measuring cognition or affect, or both?

Francis

Love

2019

WIRES Cognitive Science

View full text Add to dashboard Cite

Listening effort is increasingly recognized as a factor in communication, particularly for and with nonnative speakers, for the elderly, for individuals with hearing impairment and/or for those working in noise. However, as highlighted by McGarrigle et al., International Journal of Audiology, 2014, 53, 433–445, the term “listening effort” encompasses a wide variety of concepts, including the engagement and control of multiple possibly distinct neural systems for information processing, and the affective response to the expenditure of those resources in a given context. Thus, experimental or clinical methods intended to objectively quantify listening effort may ultimately reflect a complex interaction between the operations of one or more of those information processing systems, and/or the affective and motivational response to the demand on those systems. Here we examine theoretical, behavioral, and psychophysiological factors related to resolving the question of what we are measuring, and why, when we measure “listening effort.” This article is categorized under: Linguistics > Language in Mind and Brain Psychology > Theory and Methods Psychology > Attention Psychology > Emotion and Motivation

show abstract

Functional localization of audiovisual speech using near infrared spectroscopy

et al. 2022

View full text Add to dashboard Cite

Visual cues are especially vital for hearing impaired individuals such as cochlear implant (CI) users to understand speech in noise. Functional Near Infrared Spectroscopy (fNIRS) is a light-based imaging technology that is ideally suited for measuring the brain activity of CI users due to its compatibility with both the ferromagnetic and electrical components of these implants. In a preliminary step toward better elucidating the behavioral and neural correlates of audiovisual (AV) speech integration in CI users, we designed a speech-in-noise task and measured the extent to which 24 normal hearing individuals could integrate the audio of spoken monosyllabic words with the corresponding visual signals of a female speaker. In our behavioral task, we found that audiovisual pairings provided average improvements of 103% and 197% over auditory-alone listening conditions in −6 and −9 dB signal-to-noise ratios consisting of multi-talker background noise. In an fNIRS task using similar stimuli, we measured activity during auditory-only listening, visual-only lipreading, and AV listening conditions. We identified cortical activity in all three conditions over regions of middle and superior temporal cortex typically associated with speech processing and audiovisual integration. In addition, three channels active during the lipreading condition showed uncorrected correlations associated with behavioral measures of audiovisual gain as well as with the McGurk effect. Further work focusing primarily on the regions of interest identified in this study could test how AV speech integration may differ for CI users who rely on this mechanism for daily communication.

show abstract

Visual Cues and Listening Effort: Individual Variability

Abstract: Overall, the results support the hypothesis that integrating auditory and visual cues requires cognitive resources in some participants. The data indicate that low lipreading ability or low WMC is associated with relatively effortful integration of auditory and visual information in noise.

Cited by 101 publications

References 73 publications

Exploring Cognitive Spare Capacity : Executive Processing of Degraded Speech

Exploring Cognitive Spare Capacity : Executive Processing of Degraded Speech

Listening effort: Are we measuring cognition or affect, or both?

Functional localization of audiovisual speech using near infrared spectroscopy

Contact Info

Product

Resources

About