Capturing and View-Dependent Rendering of Billboard Models

Lee, Oliver; Bhushan, Anusheel; Diaz-Gutierrez, Pablo; Gopi, M.

doi:10.1007/11595755_73

Cited by 1 publication

(1 citation statement)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, these methods are not suited for our target application, since they rely on controlled scenes, depth data or even given models. Lee et al [LBDGG05] proposed a method to extract billboards from optical flow. However, they used generated input images from synthetic models with high quality.…”

Section: Related Workmentioning

confidence: 99%

Articulated Billboards for Video‐based Rendering

Germann

Hornung

Keiser³

et al. 2010

Computer Graphics Forum

View full text Add to dashboard Cite

We present a novel representation and rendering method for free-viewpoint video of human characters based on multiple input video streams. The basic idea is to approximate the articulated 3D shape of the human body using a subdivision into textured billboards along the skeleton structure. Billboards are clustered to fans such that each skeleton bone contains one billboard per source camera. We call this representation articulated billboards. In the paper we describe a semi-automatic, data-driven algorithm to construct and render this representation, which robustly handles even challenging acquisition scenarios characterized by sparse camera positioning, inaccurate camera calibration, low video resolution, or occlusions in the scene. First, for each input view, a 2D pose estimation based on image silhouettes, motion capture data, and temporal video coherence is used to create a segmentation mask for each body part. Then, from the 2D poses and the segmentation, the actual articulated billboard model is constructed by a 3D joint optimization and compensation for camera calibration errors. The rendering method includes a novel way of blending the textural contributions of each billboard and features an adaptive seam correction to eliminate visible discontinuities between adjacent billboards textures. Our articulated billboards do not only minimize ghosting artifacts known from conventional billboard rendering, but also alleviate restrictions to the setup and sensitivities to errors of more complex 3D representations and multiview reconstruction techniques. Our results demonstrate the flexibility and the robustness of our approach with high quality free-viewpoint video generated from broadcast footage of challenging, uncontrolled environments.

show abstract

Section: Related Workmentioning

confidence: 99%