The Effects of Modulating Fundamental Frequency and Speech Rate on the Intelligibility, Communication Efficiency, and Perceived Naturalness of Synthetic Speech

Abstract

Purpose This study investigated how modulating fundamental frequency (f0) and speech rate differentially impact the naturalness, intelligibility, and communication efficiency of synthetic speech. Method Sixteen sentences of varying prosodic content were developed via a speech synthesizer. The f0 contour and speech rate of these sentences were altered to produce 4 stimulus sets: (a) normal rate with a fixed f0 level, (b) slow rate with a fixed f0 level, (c) normal rate with prosodically natural f0 variation, and (d) normal rate with prosodically unnatural f0 variation. Sixteen listeners provided orthographic transcriptions and judgments of naturalness for these stimuli. Results Sentences with f0 variation were rated as more natural than those with a fixed f0 level. Conversely, sentences with a fixed f0 level demonstrated higher intelligibility than those with f0 variation. Speech rate did not affect the intelligibility of stimuli with a fixed f0 level. Communication efficiency was highest for sentences produced at a normal rate and a fixed f0 level. Conclusions Sentence-level f0 variation increased naturalness ratings of synthesized speech, whether the variation was prosodically natural or not. However, these f0 variations reduced intelligibility. There is evidence of a trade-off in naturalness and intelligibility of synthesized speech, which may impact future speech synthesis designs. Supplemental Material https://doi.org/10.23641/asha.8847833

Effectiveness of Musical Training on Reading Comprehension in Elementary School Children. Is There an Associative Cognitive Benefit?

“…In parallel, other studies indicate a possible association between aspects of executive functions, like switching, monitoring, selective attention, and musical performance (Bialystok and DePape, 2009;Christopher and Shelton, 2017). Analogously, in the last two decades, researchers emphasize the possible contributing role of executive functions in music education (Vojtech et al, 2019). It is widely accepted that executive functions play a positive role in nearly all cognitive tasks and abilities (Hannon and Trainor, 2007), and playing an instrument involves daily use of selective attention, switching, inhibition, and monitoring which are aspects of executive functions (Jäncke, 2009).…”

Percepção auditiva da fala nas modalidades gravada e à viva voz em usuários de implante coclear e/ou aparelho de amplificação sonora individual

“…Além das habilidades auditivas relacionadas ao processamento auditivo, a frequência fundamental (F0) e a velocidade da fala do locutor podem afetar o reconhecimento da fala em ouvintes (Vojtech et al, 2019). Somada a essa questão, há evidencias de que a F0 da mulher varia conforme o ciclo menstrual (Lã and Polo, 2020) e a idade (Russell et al, 1995).…”

“…Corr (r) -0,510 -0,422 -0,439 -0,448 -0,458 -0,375 -0,428 -0,366 P-valor <0,001 0,003 0,002 0,001 0,001 0,009 0,002 0,010 Corr (r) -0,463 -0,397 -0,433 -0,382 -0,463 -0,365 -0,348 -0,300 P-valor 0,001 0,005 0,002 0,007 0,001 0,011 0,015 0,038 Corr (r) -0,412 -0,387 -0,322 -0,401 -0,409 -0,273 -0,299 -0,265 P-valor 0,004 0,007 0,025 0,005 0,004 0,060 0,039 0,068 Corr (r) -0,372 -0,246 -0,352 -0,387 -0,241 -0,248 -0,372 -0,323 P-valor 0,009 0,092 0,014 0,007 0,098 0,090 0,009 0,025 Média Tempo Uso As apresentações do teste de reconhecimento de fala na forma à viva voz demonstram que pode ser influenciada por variáveis como timbre vocal, sotaque, intensidade, rouquidão e velocidade de fala. Tais variáveis podem se modificar ao longo do tempo em um mesmo individuo devido a questões de saúde, variações hormonais, uso de substâncias, idade, entre outras condições (Russell et al, 1995;Tsao and Weismer, 1997;Harris et al, 2001;Vojtech et al, 2019). Viva Voz 16,7 10,0 11,5 10,0 20,0 10,0 30,0 3 13,1 Gravado 6,7 0,0 11,5 0,0 10,0 0,0 20,0 3 13,1…”