Automatic Recognition of Sound Categories from Their Vocal Imitation Using Audio Primitives Automatically Found by SI-PLCA and HMM

Marchetto, Enrico; Peeters, Geoffroy

doi:10.1007/978-3-030-01692-0_1

Cited by 3 publications

(4 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Some phoneticians have turned their attention to non-speech voice production, trying to identify the most relevant phonetic components that are found in vocal imitations [30]. They identified the broad categories of phonation (i.e., quasi-periodic oscillations due to vocal fold vibrations), turbulence, supraglottal myoelastic vibrations, and clicks, which can be extracted automatically from audio with time-frequency analysis and supervised [31] or unsupervised [32] machine learning. These categories can be made to correspond to categories of sounds as they are perceived [33], and as they are produced in the physical world.…”

Section: Voice As Embodied Soundmentioning

confidence: 99%

“…A projector system Π i in the (Hilbert) space of states is Hermitian, idempotent, and complete. If the system is in state |ψ before measurement, the probability that the outcome of a measurement through a projector system returns j is p m ( j|ψ) = ψ|Π j |ψ , (32) and as a result of the measurement, the system collapses in state ψ ( j|ψ) . Given an orthonormal basis of measurement vectors |a j , the elementary projectors are Π j = |a j a j |, p m ( j|ψ) = | ψ|a j | 2 , and the system (by neglecting a unitary phasor) collapses into ψ…”

Section: Measurementmentioning

confidence: 99%

See 1 more Smart Citation

A quantum vocal theory of sound

Rocchesso

Mannone

2020

Quantum Inf Process

View full text Add to dashboard Cite

Concepts and formalism from acoustics are often used to exemplify quantum mechanics. Conversely, quantum mechanics could be used to achieve a new perspective on acoustics, as shown by Gabor studies. Here, we focus in particular on the study of human voice, considered as a probe to investigate the world of sounds. We present a theoretical framework that is based on observables of vocal production, and on some measurement apparati that can be used both for analysis and synthesis. In analogy to the description of spin states of a particle, the quantum-mechanical formalism is used to describe the relations between the fundamental states associated with phonetic labels such as phonation, turbulence, and supraglottal myoelastic vibrations. The intermingling of these states, and their temporal evolution, can still be interpreted in the Fourier/Gabor plane, and effective extractors can be implemented. The bases for a quantum vocal theory of sound, with implications in sound analysis and design, are presented.

show abstract

Section: Voice As Embodied Soundmentioning

confidence: 99%

Section: Measurementmentioning

confidence: 99%

A quantum vocal theory of sound

Rocchesso

Mannone

2020

Quantum Inf Process

View full text Add to dashboard Cite

show abstract

“…Some phoneticians have turned their attention to non-speech voice production, trying to identify the most relevant phonetic components that are found in vocal imitations [24]. They identified the broad categories of phonation (i.e., quasi periodic oscillations due to vocal fold vibrations), turbulence, supraglottal myoelastic vibrations, and clicks, which can be extracted automatically from audio with time-frequency analysis and supervised [19] or unsupervised [36] machine learning. These categories can be made to correspond to categories of sounds as they are perceived [32], and as they are produced in the physical world.…”

Section: Voice As Embodied Soundmentioning

confidence: 99%

“…The density matrix (18) would evolve according to equation (24), where the unitary operator U(0, t) is defined as in (25). When a pitch measurement is taken, the outcome would be up or down according to equation (35), and the density matrix that results from collapsing would be given by equation (36).…”

Section: Mixed As In a Mixermentioning

confidence: 99%

A Quantum Vocal Theory of Sound

Rocchesso¹,

Mannone²

2020

Preprint

View full text Add to dashboard Cite

Concepts and formalism from acoustics are often used to exemplify quantum mechanics. Conversely, quantum mechanics could be used to achieve a new perspective on acoustics, as shown by Gabor studies. Here, we focus in particular on the study of human voice, considered as a probe to investigate the world of sounds. We present a theoretical framework that is based on observables of vocal production, and on some measurement apparati that can be used both for analysis and synthesis. In analogy to the description of spin states of a particle, the quantummechanical formalism is used to describe the relations between the fundamental states associated with phonetic labels such as phonation, turbulence, and supraglottal myoelastic vibrations. The intermingling of these states, and their temporal evolution, can still be interpreted in the Fourier/Gabor plane, and effective extractors can be implemented. The bases for a Quantum Vocal Theory of Sound, with implications in sound analysis and design, are presented.

show abstract

The Deep Learning Revolution in MIR: The Pros and Cons, the Needs and the Challenges

Peeters

2021

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Automatic Recognition of Sound Categories from Their Vocal Imitation Using Audio Primitives Automatically Found by SI-PLCA and HMM

Cited by 3 publications

References 12 publications

A quantum vocal theory of sound

A quantum vocal theory of sound

A Quantum Vocal Theory of Sound

The Deep Learning Revolution in MIR: The Pros and Cons, the Needs and the Challenges

Contact Info

Product

Resources

About