Emotional Speech-Driven 3D Body Animation via Disentangled Latent Diffusion

Chhatre, Kiran; Daněček, Radek; Athanasiou, Nikos; Becherini, Giorgio; Peters, Christopher; Black, Michael J.; Bolkart, Timo

doi:10.1109/cvpr52733.2024.00190

2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024

DOI: 10.1109/cvpr52733.2024.00190

|View full text |Cite

Emotional Speech-Driven 3D Body Animation via Disentangled Latent Diffusion

Kiran Chhatre,

Radek Daněček,

Nikos Athanasiou

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Other1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 89 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation

Chen,

Li,

Ding

et al. 2024

Proceedings of the 32nd ACM International Conference on Multimedia

View full text Add to dashboard Cite

Figure 1: Given an audio of speech, as well as arbitrary motion-related text prompt, our method can generate full-body synergistic motion matching both speech content and prompt even if the motion is unseen in the speech-to-motion dataset used for training, such as the "walking in a clockwise circle" example in the figure. Meanwhile, the generation result is also highly consistent with the script content and the audio rhythm of the input speech.

show abstract

Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation

Chen,

Li,

Ding

et al. 2024

Proceedings of the 32nd ACM International Conference on Multimedia

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Emotional Speech-Driven 3D Body Animation via Disentangled Latent Diffusion

Cited by 1 publication

References 89 publications

Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation

Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation

Contact Info

Product

Resources

About