It's About Time: Minimizing Hardware and Software Latencies in Speech Research With Real-Time Auditory Feedback

Kim, Kwang S.; Wang, Hantao; Max, Ludo

doi:10.1044/2020_jslhr-19-00419

Cited by 36 publications

(23 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The feedback signal was fed to the individual via over-the-ear headphones (3.5 mm stereo, Peltor workstyle, Type HT7A-30GP) with less than 25 ms of delay, similar to our previous study 77 . This delay represents the time needed for three processing levels including the signal input to the audio interface, processing of the audio signal, and finally audio output from the interface to the headphone 78 .…”

Section: Methodsmentioning

confidence: 99%

Adaptation to pitch-altered feedback is independent of one’s own voice pitch sensitivity

Alemi

Lehmann

Deroche

2020

Sci Rep

View full text Add to dashboard Cite

Monitoring voice pitch is a fine-tuned process in daily conversations as conveying accurately the linguistic and affective cues in a given utterance depends on the precise control of phonation and intonation. This monitoring is thought to depend on whether the error is treated as self-generated or externally-generated, resulting in either a correction or inflation of errors. The present study reports on two separate paradigms of adaptation to altered feedback to explore whether participants could behave in a more cohesive manner once the error is of comparable size perceptually. The vocal behavior of normal-hearing and fluent speakers was recorded in response to a personalized size of pitch shift versus a non-specific size, one semitone. The personalized size of shift was determined based on the just-noticeable difference in fundamental frequency (F0) of each participant’s voice. Here we show that both tasks successfully demonstrated opposing responses to a constant and predictable F0 perturbation (on from the production onset) but these effects barely carried over once the feedback was back to normal, depicting a pattern that bears some resemblance to compensatory responses. Experiencing a F0 shift that is perceived as self-generated (because it was precisely just-noticeable) is not enough to force speakers to behave more consistently and more homogeneously in an opposing manner. On the contrary, our results suggest that the type of the response as well as the magnitude of the response do not depend in any trivial way on the sensitivity of participants to their own voice pitch. Based on this finding, we speculate that error correction could possibly occur even with a bionic ear, typically even when F0 cues are too subtle for cochlear implant users to detect accurately.

show abstract

Section: Methodsmentioning

confidence: 99%

Adaptation to pitch-altered feedback is independent of one’s own voice pitch sensitivity

Alemi

Lehmann

Deroche

2020

Sci Rep

View full text Add to dashboard Cite

show abstract

“…As illustrated in Figure 1A, the microphone signal was amplified (DI/O Preamp System II, ART) and recorded on one channel of a CD recorder (CD-RW901SL, Tascam). The same signal was also routed to a vocal processor (VoiceOne, TC Helicon) that can manipulate all formant frequencies (i.e., resonance frequencies of the vocal tract) in real-time with a total feedback loop delay of only 10 ms 1 (Kim et al, 2020). The processor's output was routed to a headphones amplifier (S-phone, Samson) and insert earphones (ER-3A, Etymotic Research) worn by the participant.…”

Section: Experimental Set-upmentioning

confidence: 99%

Dissociated development of speech and limb sensorimotor learning in stuttering: speech auditory-motor learning is impaired in both children and adults who stutter

Kim

Daliri

Flanagan

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

Stuttering is a neurodevelopmental disorder of speech fluency. Various experimental paradigms have demonstrated that affected individuals show limitations in sensorimotor control and learning. However, controversy exists regarding two core aspects of this perspective. First, it has been claimed that sensorimotor learning limitations are detectable only in adults who stutter (after years of coping with the disorder) but not during childhood close to the onset of stuttering. Second, it remains unclear whether stuttering individuals' sensorimotor learning limitations affect only speech movements or also unrelated effector systems involved in nonspeech movements. We report data from separate experiments investigating speech auditory-motor learning (N = 60) and limb visuomotor learning (N = 84) in both children and adults who stutter versus matched nonstuttering individuals. Both children and adults who stutter showed statistically significant limitations in speech auditory-motor adaptation with formant-shifted feedback. This limitation was more profound in children than in adults and in younger children versus older children. Between-group differences in the adaptation of reach movements performed with rotated visual feedback were subtle but statistically significant for adults. In children, even the nonstuttering groups showed limited visuomotor adaptation just like their stuttering peers. We conclude that sensorimotor learning is impaired in individuals who stutter, and that the ability for speech auditory-motor learning -- which was already adult-like in 3-6 year-old typically developing children -- is severely compromised in young children near the onset of stuttering. Thus, motor learning limitations may play an important role in the fundamental mechanisms contributing to the onset of this speech disorder.

show abstract

“…The measured latency for our experimental setup with the applied temporal perturbation is 35 ms (cf. Kim et al 2020). In addition, when the consonant is lengthened, the vowel onset is also delayed relative to production by the amount of consonant lengthening-about 40 ms in the three words used in the analysis.…”

Section: Discussionmentioning

confidence: 98%

Auditory feedback is used for adaptive control of timing in speech

Karlin¹,

Parrell²,

Naber³

2020

Preprint

View full text Add to dashboard Cite

Real-time altered auditory feedback has demonstrated a key role for auditory feedback in both online feedback control and in updating feedforward control for future utterances. Much of this research has examined control in the spectral domain, and has found that speakers compensate for perturbations to vowel formants, intensity, and fricative center of gravity. The aim of the current study is to examine adaptation in response to temporal perturbation, using real-time perturbation of ongoing speech. Word-initial consonant targets (VOT for /k, g/ and fricative duration for /s, z/) were lengthened and the following stressed vowel (/æ/) was shortened. Overall, speakers did not adapt to lengthened consonants, but did lengthen vowels by nearly 100\% of the perturbation magnitude in response to shortening. Vowel lengthening showed continued aftereffects during a washout phase when perturbation was abruptly removed. Although speakers did not actively adapt consonant durations, the adaptation in vowel duration leads to the consonant taking up an overall smaller proportion of the syllable, aligning with previous research that suggests that speakers attend to proportional durations rather than absolute durations. These results indicate that speakers actively monitor duration and update upcoming plans accordingly.

show abstract

It's About Time: Minimizing Hardware and Software Latencies in Speech Research With Real-Time Auditory Feedback

Cited by 36 publications

References 36 publications

Adaptation to pitch-altered feedback is independent of one’s own voice pitch sensitivity

Adaptation to pitch-altered feedback is independent of one’s own voice pitch sensitivity

Dissociated development of speech and limb sensorimotor learning in stuttering: speech auditory-motor learning is impaired in both children and adults who stutter

Auditory feedback is used for adaptive control of timing in speech

Contact Info

Product

Resources

About