The Effect of Narrow-Band Transmission on Recognition of Paralinguistic Information From Human Vocalizations

Abstract

Practically, no knowledge exists on the effects of speech coding and recognition for narrow-band transmission of speech signals within certain frequency ranges especially in relation to the recognition of paralinguistic cues in speech. We thus investigated the impact of narrow-band standard speech coders on the machine-based classification of affective vocalizations and clinical vocal recordings. In addition, we analyzed the effect of speech low-pass filtering by a set of different cut-off frequencies, either chosen as static values in the 0.5-5-kHz range or given dynamically by different upper limits from the first five speech formants (F1-F5). Speech coding and recognition were tested, first, according to short-term speaker states by using affective vocalizations as given by the Geneva Multimodal Emotion Portrayals. Second, in relation to long-term speaker traits, we tested vocal recording from clinical populations involving speech impairments as found in the Child Pathological Speech Database. We employ a large acoustic feature space derived from the Interspeech Computational Paralinguistics Challenge. Besides analysis of the sheer corruption outcome, we analyzed the potential of matched and multicondition training as opposed to miss-matched condition. In the results, first, multicondition and matched-condition training significantly increase performances as opposed to mismatched condition. Second, downgrades in classification accuracy occur, however, only at comparably severe levels of low-pass filtering. The downgrades especially appear for multi-categorical rather than for binary decisions. These can be dealt with reasonably by the alluded strategies

Translating Paralinguistic and Onomatopoeia: An Analysis on the Novel “Bumi Manusia” by Pramoedya Ananta Toer and its Translation ”This Earth of Mandkind” by Max Lane

“…No matter how small it is, paralinguistic has a big role in a communication, s`o that taking paralinguistics into consideration when translating a text, especially the one involving a depiction of everyday life interactions, is considered very important. Fruhholz et al (2016) support this opinion.…”

Sensor-Based Technology for Social Information Processing in Autism: A Review

“…Comparisons between groups and emotions showed relatively poor classification performance ASD children’s’ voices, particularly for ‘Anger’ for both the Swedish and English dataset, and for ‘Afraid’ for Hebrew-speaking children with ASD. Although using a pre-existing dataset, a study on automatic voice perception showed that an algorithm successfully classified up to 61.1% of voice samples of children actually diagnosed with and without autism [60]. Ringeval et al [45] assessed verbal prosody in ASD children, children with pervasive developmental disorder (PDD), children with specific language impairment (SLI), and TD children (aged around 9–10 years, with 10–13 children per clinical group).…”

Robust Speech Emotion Recognition Under Different Encoding Conditions

“…On the other hand, model accuracy was severely degraded when features were extracted from unvoiced segments only. Frühholz et al [9] investigated the narrow-band encoded and low-pass filtered cases for short-term speaker state and longterm speaker trait recognition. The study focused on narrowband low-bitrate speech coders used in telecommunications and high dimensional feature exaction as input to an SVM classifier.…”