Rigid-Body Sound Synthesis with Differentiable Modal Resonators

Díaz, R. F.; Hayes, Ben; Saitis, Charalampos; Fazekas, György; Sandler, Mark

doi:10.1109/icassp49357.2023.10095139

ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2023

DOI: 10.1109/icassp49357.2023.10095139

|View full text |Cite

Rigid-Body Sound Synthesis with Differentiable Modal Resonators

R. F. Díaz

Ben Hayes

Charalampos Saitis

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article2

Relationship

Self Cite1

Independent1

Authors

Journals

Cited by 2 publications

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Learning to Solve Inverse Problems for Perceptual Sound Matching

Han,

Lostanlen,

Lagrange

2024

IEEE/ACM Trans. Audio Speech Lang. Process.

View full text Add to dashboard Cite

Learning to Solve Inverse Problems for Perceptual Sound Matching

Han,

Lostanlen,

Lagrange

2024

IEEE/ACM Trans. Audio Speech Lang. Process.

View full text Add to dashboard Cite

A review of differentiable digital signal processing for music and speech synthesis

Hayes,

Shier,

Fazekas

et al. 2024

Front. Signal Process.

Self Cite

View full text Add to dashboard Cite

The term “differentiable digital signal processing” describes a family of techniques in which loss function gradients are backpropagated through digital signal processors, facilitating their integration into neural networks. This article surveys the literature on differentiable audio signal processing, focusing on its use in music and speech synthesis. We catalogue applications to tasks including music performance rendering, sound matching, and voice transformation, discussing the motivations for and implications of the use of this methodology. This is accompanied by an overview of digital signal processing operations that have been implemented differentiably, which is further supported by a web book containing practical advice on differentiable synthesiser programming (https://intro2ddsp.github.io/). Finally, we highlight open challenges, including optimisation pathologies, robustness to real-world conditions, and design trade-offs, and discuss directions for future research.

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Rigid-Body Sound Synthesis with Differentiable Modal Resonators

Cited by 2 publications

References 12 publications

Learning to Solve Inverse Problems for Perceptual Sound Matching

Learning to Solve Inverse Problems for Perceptual Sound Matching

A review of differentiable digital signal processing for music and speech synthesis

Contact Info

Product

Resources

About