Multi-pitch estimation of audio recordings using a codebook-based approach

Hansen, Martin; Jensen, Jesper Rindom; Christensen, Mads Græsbøll

doi:10.1109/eusipco.2016.7760395

Cited by 2 publications

(3 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, a method for joint multi-pitch and model order estimation of delay and amplitude panned mixtures of harmonic sources has been proposed. The method presented here extends the work in [14] and [13], where stereophonic mixtures of monophonic sources, and single-channel multipitch mixtures were considered, respectively. The proposed method is based on a signal model that takes the panning parameters of a mixture into account.…”

Section: Discussionmentioning

confidence: 80%

“…The data used is single-channel, i.e, K = 1, and the number of sources is M = 2. This type of evaluation is similar to the one in [13], however, here the pitch is estimated jointly with the model order. The metric used is similar to the one used in the first experiment.…”

Section: Methodsmentioning

confidence: 99%

“…In this way, the fundamental frequencies of harmonic sources, with overlapping harmonics, can be resolved. In relation to the work presented in [13], where a codebook-based approach for multi-pitch estimation was proposed, the work presented in this paper is based on a stereophonic signal model, introduced in [14], in which a pitch estimator, which takes the amplitude and delay panning parameters into account when estimating the fundamental frequencies of stereophonic mixtures of single-pitch signals, was proposed. Furthermore, in the work presented here, the model order of each harmonic source is estimated jointly with its fundamental frequency.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Estimation of multiple pitches in stereophonic mixtures using a codebook-based approach

Hansen

Jensen

Christensen

2017

2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Self Cite

View full text Add to dashboard Cite

In this paper, a method for multi-pitch estimation of stereophonic mixtures of multiple harmonic signals is presented. The method is based on a signal model which takes the amplitude and delay panning parameters of the sources in a stereophonic mixture into account. Furthermore, the method is based on the extended invariance principle (EXIP), and a codebook of realistic amplitude vectors. For each fundamental frequency candidate in each of the sources, the amplitude estimates are mapped to entries in the codebook, and the pitch and model order are estimated jointly. The performance of the proposed method is evaluated using mixtures of real signals. Experiments show an increase in performance when knowledge about the panning parameters is utilized together with the codebook of magnitude amplitudes when compared to a state-of-the-art transcription method.

show abstract

Section: Discussionmentioning

confidence: 80%

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Estimation of multiple pitches in stereophonic mixtures using a codebook-based approach

Hansen

Jensen

Christensen

2017

2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Self Cite

View full text Add to dashboard Cite

show abstract

Estimation of Fundamental Frequencies in Stereophonic Music Mixtures

Hansen

Jensen

Christensen

2019

IEEE/ACM Trans. Audio Speech Lang. Process.

Self Cite

View full text Add to dashboard Cite

In this paper, a method for multi-pitch estimation of stereophonic mixtures of harmonic signals, e.g., instrument recordings, is presented. The proposed method is based on a signal model which includes the panning parameters of the sources in a stereophonic mixture, such as those applied artificially in a recording studio. If the sources in a mixture have different panning parameters, this diversity can be used to simplify the pitch estimation problem. The mixing parameters of the sources might be shared, resulting in a multipitch estimation problem, which is solved using an approach based on an expectation-maximization algorithm for Gaussian sources, where the fundamental frequencies and model orders are estimated jointly. The fundamental frequencies may be related, resulting in overlapping harmonics, complicating the estimation of the parameters. A codebook of harmonic amplitude vectors is trained on recordings of instruments playing single notes, and used when estimating the amplitudes of the mixture components. The proposed method is evaluated using stereophonic mixtures of instrument recordings, and is compared to state-of-the-art transcription and multi-pitch estimation methods. Experiments show an increase in performance when knowledge about the panning parameters is taken into account. The proposed method provides a full parametrization of the components of the observed signal. Possible applications include instrument tuning, audio editing tools, modification of harmonic mixture components, and audio effects.

show abstract

Multi-pitch estimation of audio recordings using a codebook-based approach

Cited by 2 publications

References 22 publications

Estimation of multiple pitches in stereophonic mixtures using a codebook-based approach

Estimation of multiple pitches in stereophonic mixtures using a codebook-based approach

Estimation of Fundamental Frequencies in Stereophonic Music Mixtures

Contact Info

Product

Resources

About