2023
DOI: 10.1111/cgf.14776
|View full text |Cite
|
Sign up to set email alerts
|

A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

Abstract: Gestures that accompany speech are an essential part of natural and efficient embodied human communication. The automatic generation of such co‐speech gestures is a long‐standing problem in computer animation and is considered an enabling technology for creating believable characters in film, games, and virtual social spaces, as well as for interaction with social robots. The problem is made challenging by the idiosyncratic and non‐periodic nature of human co‐speech gesture motion, and by the great diversity o… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1

Citation Types

0
4
0

Year Published

2023
2023
2024
2024

Publication Types

Select...
5
2

Relationship

0
7

Authors

Journals

citations
Cited by 36 publications
(9 citation statements)
references
References 201 publications
0
4
0
Order By: Relevance
“…In this paper, we focus on the specification problem. For a review of the work on the animation problem see [54]. The specification problem can be approached with rule-based or data-driven approaches which the following sections discuss.…”
Section: Related Workmentioning
confidence: 99%
See 3 more Smart Citations
“…In this paper, we focus on the specification problem. For a review of the work on the animation problem see [54]. The specification problem can be approached with rule-based or data-driven approaches which the following sections discuss.…”
Section: Related Workmentioning
confidence: 99%
“…Because of this, data-driven gesture generation increasingly uses machine learning techniques, and specifically deep learning [1,54]. Many of these approaches use encode-decoder recurrent neural networks that learn the mapping from utterance text to gestures [6,72,73].…”
Section: Data-driven Gesture Generationmentioning
confidence: 99%
See 2 more Smart Citations
“…As a result, new workflows for generating animation driven by data need to be proposed, implemented, and properly evaluated. Recent developments in deep learning techniques have proven to be particularly useful for such data-driven workflows for gesture synthesis [Nyatsanga et al 2023] and they hold immense potential for being applied to facial animation synthesis as well. More specifically, speech-driven facial animation synthesis is now being widely explored in both academic research [Cudeiro et al 2019;Fan et al 2021a;Xing et al 2023] and industry [JALI 2023].…”
mentioning
confidence: 99%