Video-based character animation

Starck, Jonathan; Miller, Gregor; Hilton, Adrian

doi:10.1145/1073368.1073375

Cited by 59 publications

(44 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We describe both the construction of the Surface Motion Graph, and an optimisation algorithm that can incorporate high-level user constraints on timing, position and motion to synthesise high quality animated sequences. This extends earlier re- search on Surface Motion Graphs [Starck et al 2005;Huang et al 2009] which used unaligned mesh sequences and required manual graph construction. In this paper, 3D mesh sequences are first nonrigidly aligned [Budd et al 2012] to produce a temporally coherent 4D sequence.…”

Section: Introductionmentioning

confidence: 68%

“…This allows non-linear interpolation between captured sequences at transitions giving improved motion continuity over previous surface motion graph approaches based on a single frame transitions [Starck et al 2005;Huang et al 2009]. The use of a separate learnt deformation space for each body part also extends the range of motion allowing synthesis of novel poses outside the observed range of motion.…”

Section: Discussion and Limitationsmentioning

confidence: 99%

“…To ensure accurate matching of both shape and appearance the volumetric descriptor is extended in this work to include surface colour information. The use of motion graphs for animation from surface sequences was first introduced in [Starck et al 2005] but required manual graph construction. Huang et al [Huang et al 2009] addressed automatic SMG construction based on shape similarity allowing animation synthesis by concatenation of unaligned mesh sequences without video textures.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture

et al. 2015

View full text Add to dashboard Cite

We present a novel hybrid representation for character animation from 4D Performance Capture (4DPC) data which combines skeletal control with surface motion graphs. 4DPC data are temporally aligned 3D mesh sequence reconstructions of the dynamic surface shape and associated appearance from multiple view video. The hybrid representation supports the production of novel surface sequences which satisfy constraints from user specified key-frames or a target skeletal motion. Motion graph path optimisation concatenates fragments of 4DPC data to satisfy the constraints whilst maintaining plausible surface motion at transitions between sequences. Spacetime editing of the mesh sequence using a learnt part-based Laplacian surface deformation model is performed to match the target skeletal motion and transition between sequences. The approach is quantitatively evaluated for three 4DPC datasets with a variety of clothing styles. Results for key-frame animation demonstrate production of novel sequences which satisfy constraints on timing and position of less than 1% of the sequence duration and path length. Evaluation of motion capture driven animation over a corpus of 130 sequences shows that the synthesised motion accurately matches the target skeletal motion. The combination of skeletal control with the surface motion graph extends the range and style of motion which can be produced whilst maintaining the natural dynamics of shape and appearance from the captured performance.

show abstract

Section: Introductionmentioning

confidence: 68%

Section: Discussion and Limitationsmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture

et al. 2015

View full text Add to dashboard Cite

show abstract

“…In related work [16] we proposed animation by example using free-viewpoint video of human motions to provide a complete 3D digital representation. In this paper we present a complete system for surface capture and a free-viewpoint video representation suitable for use in animation production from a recorded human performance.…”

Section: Related Work (Sidebar Refs [2]-[16])mentioning

confidence: 99%

Surface Capture for Performance-Based Animation

Starck

Hilton

2007

IEEE Comput. Grap. Appl.

414

365

View full text Add to dashboard Cite

Digital content production traditionally requires highly skilled artists and animators to first manually craft shape and appearance models and then instill the models with a believable performance. Motion capture technology is now increasingly used to record the articulated motion of a real human performance to increase the visual realism in animation. Motion capture is limited to recording only the skeletal motion of the human body and requires the use of specialist suits and markers to track articulated motion.In this paper we present surface capture, a fully automated system to capture shape and appearance as well as motion from multiple video cameras as a basis to create highly realistic animated content from an actor's performance in full wardrobe. We address wide-baseline scene reconstruction to provide 360 degree appearance from just 8 camera views and introduce an efficient scene representation for level of detail control in streaming and rendering. Finally we demonstrate interactive animation control in a computer games scenario using a captured library of human animation, achieving a frame rate of 300fps on consumer level graphics hardware. Index TermsImage-based modelling and rendering, Video-based character animation

show abstract

“…In previous research on 3D video surface similarity has been defined either manually or through a shape descriptor. Starck et al [20] manually identify transitions to construct a motion graph for interactive control using 3D video sequences to preserve dynamic surface shape and appearance. Xu [26] et al re-use 3D video in a framework of motion editing they compute shape histograms in spherical coordinate system to measure frameto-frame dissimilarity.…”

Section: Motion Synthesismentioning

confidence: 99%

Human motion synthesis from 3D video

Huang

Hilton

Starck

2009

2009 IEEE Conference on Computer Vision and Pattern Recognition

Self Cite

View full text Add to dashboard Cite

Multiple view 3D video reconstruction of actor performance captures a level-of-detail for body and clothing movement which is time-consuming to produce using existing animation tools. In this paper we present a framework for concatenative synthesis from multiple 3D video sequences according to user constraints on movement, position and timing. Multiple 3D video sequences of an actor performing different movements are automatically constructed into a surface motion graph which represents the possible transitions with similar shape and motion between sequences without unnatural movement artefacts. Shape similarity over an adaptive temporal window is used to identify transitions between 3D video sequences. Novel 3D video sequences are synthesized by finding the optimal path in the surface motion graph between user specified key-frames for control of movement, location and timing. The optimal path which satisfies the user constraints whilst minimizing the total transition cost between 3D video sequences is found using integer linear programming. Results demonstrate that this framework allows flexible production of novel 3D video sequences which preserve the detailed dynamics of the captured movement for actress with loose clothing and long hair without visible artefacts.

show abstract

Video-based character animation

Abstract: In this paper we introduce a video-based representation for free viewpoint visualization and motion control of

Cited by 59 publications

References 29 publications

Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture

Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture

Surface Capture for Performance-Based Animation

Human motion synthesis from 3D video

Contact Info

Product

Resources

About