Speech analysis/Synthesis based on a sinusoidal representation

Abstract

A sinusoidal model for the speech waveform is used to develop a new analysislsynthesis technique that is characterized by the amplitudes, frequencies, and phases of the component sine waves. These parameters are estimated from the short-time Fourier transform using a simple peak-picking algorithm. Rapid changes in the highly resolved spectral components are tracked using the concept of "birth" and "death" of the underlying sine waves. For a given frequency track a cubic function is used to unwrap and interpolate the phase such that the phase track is m,aximally smooth. This phase function is applied to a sine-wave generator, which is amplitude modulated and added to the other sine waves to give the final speech output. The resulting synthetic waveform preserves the general waveform shape and is essentially perceptually indistinguishable from the original speech. Furthermore, in the presence of noise the perceptual characteristics of the speech as well as the noise are maintained. In addition, it was found that the representation was sufficiently general that high-quality reproduction was obtained for a larger class of inputs including: two overlapping, superposed speech waveforms; music waveforms; speech in musical backgrounds; and certain marine biologic sounds. Finally, the analysis/synthesis system forms the basis for new approaches to the problems of speech transformations including timescale and pitch-scale modification, and midrate speech coding [SI, [9].

Source-filter separation for nonstationary voiced speech based on sinusoidal representation

“…The model approximates speech signals as the sum of sinusoidal components with instantaneous amplitudes and frequencies that continuously vary with time [4]. In the present study, we propose a novel analysis method to estimate VTTF and F 0 for nonstationary voiced speech on the basis of sinusoidal representation.…”

Baleen Whale Sound Synthesis using a Modified Spectral Modeling

“…The stochastic signal is calculated by a complex spectrum envelope of the residual and an inverse STFT. We then add the deterministic component with stochastic one using an overlap add method [4,7] in time domain for each frame to obtain the synthesized whale sound. (Fig.…”

New approach in features extraction for EEG signal detection

“…In 1986, Robert McAulay and Thomas Quatieri proposed a new method for analysis/synthesis of continuous time speech signals which turned out to be a reconstruction process that provided a close approximation of the original signal [12]. EEG waves represent the combined activity of many neuronal cells which can generate sinusoidal-like oscillatory waves.…”

“…A magnitude condition is also imposed so that contiguous peaks at the same frequency which have large magnitude differences are proposed to belong to different tracks (the partials). The process of matching each frequency in frame t to some frequency in frame t + 1 is given in [12]. Fig.…”

“…To improve resolution in a TFD for feature extraction, we propose to use the McAulayQuatieri (MQ) sinusoidal model [12]. This is a robust tool used in speech processing for characterizing nonstationary speech signals from the short-time Fourier transform (STFT).…”