Autocorrelation-based features for speech representation

Abstract

This study investigates autocorrelation-based features as a potential basis for phonetic and syllabic distinctions. The work comes out of a theory of auditory signal processing based on central monaural autocorrelation and binaural crosscorrelation representations. Correlation-based features are used to predict monaural and binaural perceptual attributes that are important for the architectural acoustic design of concert halls: pitch, timbre, loudness, duration, reverberation-related coloration, sound direction, apparent source width, and envelopment (Ando, 1985(Ando, , 1998Ando and Cariani, 2009). The current study investigates the use of features of monaural autocorrelation functions (ACFs) for representing phonetic elements (vowels), syllables (CV pairs), and phrases using a small set of temporal factors extracted from the short-term running ACF. These factors include listening level (loudness), zero-lag ACF peak width (spectral tilt), τ1 (voice pitch period), φ1 (voice pitch strength), τe (effective duration of the ACF envelope, temporal repetitive continuity/contrast), segment duration, and Δφ1/Δt (the rate of pitch strength change, related to voice pitch attack-decay dynamics). Times at which ACF effective duration τe is minimal reflect rapid signal pattern changes that usefully demarcate segmental boundaries. Results suggest that vowels, CV syllables, and phrases can be distinguished on the basis of this ACF-derived feature set.

A Survey on Artificial Intelligence-Based Acoustic Source Identification

“…The maximum relation is given by +1, the minimum relation is given by −1, and the absence of any relation is represented by 0. For example, the correlation at some value of lag is less than 1 but greater than 0 depending on the extent of similarity [64]. Therefore, the correlation at zero lag will always be 1 since the signal is repeated undelayed.…”

A Large-Scale UAV Audio Dataset and Audio-Based UAV Classification Using CNN

“…The volume of a sound is one of the most straightforward features of the human auditory system. It has been used in acoustic scene classification [ 95 ], speech and music classification [ 96 ], and speech segmentation.…”

Research on the Correlation Between the Timbre Attributes of Musical Sound and Visual Color

“…Temporal centriod(TC) is the center of gravity of the signal's energy on the time axis, in seconds(s), which reflects the area where the signal's main energy is concentrated [31], and is an important parameter for describing high-transient shock signals. The formula is as follows:…”