Integration of partial information for spoken and written sentence recognition by older listeners

Smith, Kimberly G.; Fogerty, Daniel

doi:10.1121/1.4954634

Cited by 6 publications

(2 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Applications of the TRT task to sentences have varied in a number of important parameters, such as whether the sentences are presented word by word or as a whole, the color of text and masker bars, the timing of text presentation, and the number of masker bars per sentence (Krull et al, 2013;Smith & Fogerty, 2016;Zekveld et al, 2007). Whereas some of these parameters, such as color or display size, are text specific, others have ready analogues to parameters from auditory experiments of speech perception in which portions of the speech signal are periodically interrupted by masking noise or replaced with silence.…”

mentioning

confidence: 99%

Perceptual Organization of Interrupted Speech and Text

Shafiro

Fogerty

Smith

et al. 2018

J Speech Lang Hear Res

Self Cite

View full text Add to dashboard Cite

Purpose Visual recognition of interrupted text may predict speech intelligibility under adverse listening conditions. This study investigated the nature of the linguistic information and perceptual processes underlying this relationship. Method To directly compare the perceptual organization of interrupted speech and text, we examined the recognition of spoken and printed sentences interrupted at different rates in 14 adults with normal hearing. The interruption method approximated deletion and retention of rate-specific linguistic information (0.5–64 Hz) in speech by substituting either white space or silent intervals for text or speech in the original sentences. Results A similar U-shaped pattern of cross-rate variation in performance was observed in both modalities, with minima at 2 Hz. However, at the highest and lowest interruption rates, recognition accuracy was greater for text than speech, whereas the reverse was observed at middle rates. An analysis of word duration and the frequency of word sampling across interruption rates suggested that the location of the function minima was influenced by perceptual reconstruction of whole words. Overall, the findings indicate a high degree of similarity in the perceptual organization of interrupted speech and text. Conclusion The observed rate-specific variation in the perception of speech and text may potentially affect the degree to which recognition accuracy in one modality is predictive of the other.

show abstract

mentioning

confidence: 99%

Perceptual Organization of Interrupted Speech and Text

Shafiro

Fogerty

Smith

et al. 2018

J Speech Lang Hear Res

Self Cite

View full text Add to dashboard Cite

show abstract

“…6, middle and right columns). Consistent with previous literature, the benefit of text was larger when the auditory signal integrity was lower (Smith & Fogerty 2015, 2016; Krull & Humes 2016; Fogerty et al 2020). The present study adds to previous research by revealing that the text benefit was significant in all facial cue conditions.…”

Section: Discussionmentioning

confidence: 99%

Benefits of Text Supplementation on Sentence Recognition and Subjective Ratings With and Without Facial Cues for Listeners With Normal Hearing

et al. 2022

View full text Add to dashboard Cite

Objectives: Recognizing speech through telecommunication can be challenging in unfavorable listening conditions. Text supplementation or provision of facial cues can facilitate speech recognition under some circumstances. However, our understanding of the combined benefit of text and facial cues in telecommunication is limited. The purpose of this study was to investigate the potential benefit of text supplementation for sentence recognition scores and subjective ratings of spoken speech with and without facial cues available. Design: Twenty adult females (M = 24 years, range 21 to 29 years) with normal hearing performed a sentence recognition task and also completed a subjective rating questionnaire in 24 conditions. The conditions varied by integrity of the available facial cues (clear facial cues, slight distortion facial cues, great distortion facial cues, no facial cues), signal-to-noise ratio (quiet, +1 dB, −3 dB), and text availability (with text, without text). When present, the text was an 86 to 88% accurate transcription of the auditory signal presented at a 500 ms delay relative to the auditory signal. Results: The benefits of text supplementation were largest when facial cues were not available and when the signal-to-noise ratio was unfavorable. Although no recognition score benefit was present in quiet, recognition benefit was significant in all levels of background noise for all levels of facial cue integrity. Moreover, participant subjective ratings of text benefit were robust and present even in the absence of recognition benefit. Consistent with previous literature, facial cues were beneficial for sentence recognition scores in the most unfavorable signal-to-noise ratio, even when greatly distorted. It is interesting that, although all levels of facial cues were beneficial for recognition scores, participants rated a significant benefit only with clear facial cues. Conclusions: The benefit of text for auditory-only and auditory-visual speech recognition is evident in recognition scores and subjective ratings; the benefit is larger and more robust for subjective ratings than for scores. Therefore, text supplementation might provide benefit that extends beyond speech recognition scores. Combined, these findings support the use of text supplementation in telecommunication, even when facial cues are concurrently present, such as during teleconferencing or watching television.

show abstract

Recognition of Interrupted Speech, Text, and Text-Supplemented Speech by Older Adults: Effect of Interruption Rate

Fogerty

Madorskiy

Vickery

et al. 2022

J Speech Lang Hear Res

View full text Add to dashboard Cite

Purpose: Studies of speech and text interruption indicate that the interruption rate influences the perceptual information available, from whole words at slow rates to subphonemic cues at faster interruptions rates. In young adults, the benefit obtained from text supplementation of speech may depend on the type of perceptual information available in either modality. Age commonly reduces temporal aspects of information processing, which may influence the benefit older adults obtain from text-supplemented speech across interruption rates. Method: Older adults were tested unimodally and multimodally with spoken and printed sentences that were interrupted by silence or white space at various rates. Results: Results demonstrate U-shaped performance-rate functions for all modality conditions, with minimal performance around interruption rates of 2–4 Hz. Comparison to previous studies with younger adults indicates overall poorer recognition for interrupted materials by the older adults. However, as a group, older adults can integrate information between the two modalities to a similar degree as younger adults. Individual differences in multimodal integration were noted. Conclusion: Overall, these results indicate that older adults, while demonstrating poorer overall performance in comparison to younger adults, successfully combine distributed partial information across speech and text modalities to facilitate sentence recognition.

show abstract

Integration of partial information for spoken and written sentence recognition by older listeners

Cited by 6 publications

References 20 publications

Perceptual Organization of Interrupted Speech and Text

Perceptual Organization of Interrupted Speech and Text

Benefits of Text Supplementation on Sentence Recognition and Subjective Ratings With and Without Facial Cues for Listeners With Normal Hearing

Recognition of Interrupted Speech, Text, and Text-Supplemented Speech by Older Adults: Effect of Interruption Rate

Contact Info

Product

Resources

About