In this paper we present a novel approach for interactive rendering of virtual views from real image sequences.Combining the concepts of light fields, depth‐compensated image warping and view dependent texture mapping,this plenoptic modeling approach can handle large and complex scenes. A portable, handheld multi‐camera systemhas been developed that allows to record multiple image streams by simply walking around the scene. Theseimage streams are automatically calibrated and depth maps for all views are generated as input to the renderingstage. For rendering a view dependent warping surface is constructed on the fly and depth‐compensated imageinterpolation is applied with view‐dependent texture mapping. Rendering quality is scalable to allow fast previewand to achieve high‐end quality with the same approach. The system can handle large and geometrically complexscenes with hundreds of real images at interactive rates. Categories and Subject Descriptors (according to ACM CCS): I.3.3 [Computer Graphics]: Viewing algorithms, I.4.1[Image Processing and Computer Vision]: Digitization and Image Capture, I.4.8 [Image Processing and ComputerVision]: Scene Analysis

Image-based rendering is a method to synthesize novel views from a set of given real images. This contribution describes two methods to extrapolate novel views of complex scenes with occlusions and large depth discontinuities from images of a moving uncalibrated multi-camera rig. The real camera viewpoints are calibrated from the image data and dense depth maps are estimated for each real view. Novel views are synthesized from this representation with view-dependent image-based rendering techniques at interactive rates. Since the 3D scene geometry is available in this approach, it is well suited for Mixed Reality applications where synthetic 3D objects are seamlessly embedded in the novel view.

No abstract

No abstract

No abstract