Visual Shapes of Silhouette Sets

Franco, Jean-Sébastien; Lapierre, Marc; Boyer, Edmond

doi:10.1109/3dpvt.2006.148

Cited by 30 publications

(16 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is, however, very limited in the object geometries it can handle [4][5][6]. The earliest attempt of using silhouettes for 3D shape reconstruction was by Baumgart in 1974.…”

Section: Silhouette-based Reconstructionmentioning

confidence: 99%

A robust hybrid image-based modeling system

et al. 2015

View full text Add to dashboard Cite

This paper presents a new robust image-based modeling system for creating high-quality 3D models of complex objects from a sequence of unconstrained photographs. The images can be acquired by a video camera or hand-held digital camera without the need of camera calibration. In contrast to previous methods, we integrate correspondence-based and silhouette-based approaches, which significantly enhances the reconstruction of objects with few visual features (e.g., uni-colored objects) and improves surface smoothness. Our solution uses a mesh segmentation and charting approach in order to create a low-distortion mesh parameterization suitable for objects of arbitrary genus. A high-quality texture is produced by first parameterizing the reconstructed objects using a segmentation and charting approach, projecting suitable sections of input images onto the model, and combining them using a graph-cut technique. Holes in the texture due to surface patches without projecting input images are filled using a novel exemplar-based inpainting method which exploits appearance space attributes to improve patch search, and blends patches using Poisson-guided interpolation.We analyzed the effect of different algorithm parameters, and compared our system with a laser scanning-based reconstruction and existing commercial systems. Our results indicate that our system is robust, superior to other image-based modeling techniques, and can achieve a reconstruction quality visually not discernible from that of a laser scanner.

show abstract

“…It is, however, very limited in the object geometries it can handle [4][5][6]. The earliest attempt of using silhouettes for 3D shape reconstruction was by Baumgart in 1974.…”

Section: Silhouette-based Reconstructionmentioning

confidence: 99%

A robust hybrid image-based modeling system

et al. 2015

View full text Add to dashboard Cite

show abstract

“…Most of these techniques consist in computing the visual hull, which is the maximal volume consistent with a given set of silhouettes. One noticeable exception is the recent work of Franco et al [14] which constructs smooth silhouette-consistent shapes strictly included in the visual hull.…”

Section: Introductionmentioning

confidence: 97%

Spatio-Temporal Shape from Silhouette using Four-Dimensional Delaunay Meshing

Aganj

Pons

Ségonne

et al. 2007

2007 IEEE 11th International Conference on Computer Vision

View full text Add to dashboard Cite

We propose a novel method for computing a fourdimensional (4D) representation of the spatio-temporal visual hull of a dynamic scene, based on an extension of a recent provably correct Delaunay meshing algorithm. By considering time as an additional dimension, our approach exploits seamlessly the time coherence between different frames to produce a compact and high-quality 4D mesh representation of the visual hull. The 3D visual hull at a given time instant is easily obtained by intersecting this 4D mesh with a temporal plane, thus enabling interpolation of objects' shape between consecutive frames. In addition, our approach offers easy and extensive control over the size and quality of the output mesh as well as over its associated reprojection error. Our numerical experiments demonstrate the effectiveness and flexibility of our approach for generating compact, high-quality, time-coherent visual hull representations from real silhouette image data.

show abstract

“…Since then, various systems have been developed that can digitize human subjects performing various actions (Matusik et al 2000(Matusik et al , 2001Carranza et al 2003;Cheung et al 2003;Franco and Boyer 2003;Franco et al 2006;Sand et al 2003)-these systems use an indoor room-sized camera setup that typically consists of 8 to 15 synchronized cameras recording at 15 to 30 frames per second. We will refer to such an arbitrary configuration of cameras as a camera network.…”

Section: Introductionmentioning

confidence: 99%

“…Currently in all multi-camera systems (Matusik et al 2000(Matusik et al , 2001Carranza et al 2003;Cheung et al 2003;Franco and Boyer 2003;Franco et al 2006;Sand et al 2003), calibration and synchronization must be done during an offline calibration phase before the actual video is captured. Someone must be physically present in the scene with a specialized calibration object such as a planar calibration grid or a point LED, and special calibration data has to be collected.…”

Section: Introductionmentioning

confidence: 99%

Camera Network Calibration and Synchronization from Silhouettes in Archived Video

Sinha

Pollefeys

2009

Int J Comput Vis

View full text Add to dashboard Cite

In this paper we present an automatic method for calibrating a network of cameras that works by analyzing only the motion of silhouettes in the multiple video streams. This is particularly useful for automatic reconstruction of a dynamic event using a camera network in a situation where pre-calibration of the cameras is impractical or even impossible. The key contribution of this work is a RANSAC-based algorithm that simultaneously computes the epipolar geometry and synchronization of a pair of cameras only from the motion of silhouettes in video.Our approach involves first independently computing the fundamental matrix and synchronization for multiple pairs of cameras in the network. In the next stage the calibration and synchronization for the complete network is recovered from the pairwise information. Finally, a visual-hull algorithm is used to reconstruct the shape of the dynamic object from its silhouettes in video. For unsynchronized video streams with sub-frame temporal offsets, we interpolate silhouettes between successive frames to get more accurate visual hulls. We show the effectiveness of our method by remotely calibrating several different indoor camera networks from archived video streams.

show abstract

Visual Shapes of Silhouette Sets

Cited by 30 publications

References 24 publications

A robust hybrid image-based modeling system

A robust hybrid image-based modeling system

Spatio-Temporal Shape from Silhouette using Four-Dimensional Delaunay Meshing

Camera Network Calibration and Synchronization from Silhouettes in Archived Video

Contact Info

Product

Resources

About