Image Based Interactive Rendering with View Dependent Geometry

This paper presents a novel method for view-dependent rendering for monitor-based Augmented Reality (AR) applications that enhances natural visual perception. A typical monitor-based AR workstation incorporates a large monitor that acts as a window to the physical workspace in front of it. Although these workstations are often used in industrial AR applications, they unfortunately do not provide natural visual perception. This research focuses on the development of AR system and a novel method for real-time rendering of the augmented scene that incorporates the user's point of view. Thus, the user gets the impression of natural visual perception while moving in front of the monitor. This paper introduces the hardware setup, geometric registration to determine the correct view, and image processing. A sequence of images is presented that demonstrates the advantages of this method. ABSTRACTThis paper presents a novel method for view-dependent rendering for monitor-based Augmented Reality (AR) applications that enhances natural visual perception. A typical monitor-based AR workstation incorporates a large monitor that acts as a window to the physical workspace in front of it. Although these workstations are often used in industrial AR applications, they unfortunately do not provide natural visual perception. This research focuses on the development of AR system and a novel method for real-time rendering of the augmented scene that incorporates the user's point of view. Thus, the user gets the impression of natural visual perception while moving in front of the monitor. This paper introduces the hardware setup, geometric registration to determine the correct view, and image processing. A sequence of images is presented that demonstrates the advantages of this method.

show abstract

“…In [15] the authors present a similar approach. They estimate a depth map by moving a binocular camera.…”

Section: View-dependent Renderingmentioning

confidence: 99%

View-Dependent Rendering to Enhance Natural Perception for Augmented Reality Workstations

Radkowski

Oliver

2012

Volume 1: Advanced Computational Mechanics; Advanced Simulation-Based Engineering Sciences; Virtual and Augmented Reality; Appl

View full text Add to dashboard Cite

show abstract

“…Such scores could be defined in terms of the magnitude of the angle between camera i and the rendering camera by computing for example the inverse of this angle (see [5]) or its cosine (see [17]). More sophisticated measures which take into account the Euclidian distance between image centres (see [6,13]), or even the camera resolution and field-of-view (see [2,21]) could also be considered. This choice is independent of the proposed feathering algorithm.…”

Section: Problem Formulation and Notationsmentioning

confidence: 99%

“…This is a simple strategy which typically works well for scenes where there are no extreme variations in zoom factors. More sophisticated selection strategies incorporating distance between image centres (see [6,13]), camera resolution and field-of-view [2,21] could also be considered. This was not necessary for the type of scene considered in this paper.…”

Section: Camera Selection Algorithmmentioning

confidence: 99%

“…In [6], Evers-Senne and Koch present a system which generates consistent view-dependent local geometry on the fly from a collection of inaccurate depth maps recorded by a hand-held multi-camera system. The algorithm enforces consistency of the geometric proxies which would otherwise be inconsistent and affect rendering quality due to existing camera calibration errors.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Dynamic feathering: minimising blending artefacts in view-dependent rendering

Guillemaut

Kilner

Starck

et al. 2007

IET 4th European Conference on Visual Media Production (CVMP 2007)

View full text Add to dashboard Cite

Keywords:Image-based rendering, view-dependent texture mapping, feathering, image blending, image compositing. AbstractConventional view-dependent texture mapping techniques produce composite images by blending subsets of input images, weighted according to their relative influence at the rendering viewpoint, over regions where the views overlap. Geometric or camera calibration errors often result in a loss of detail due to blurring or double exposure artefacts which tends to be exacerbated by the number of blending views considered. We propose a novel view-dependent rendering technique which optimises the blend region dynamically at rendering time, and reduces the adverse effects of camera calibration or geometric errors otherwise observed. The technique has been successfully integrated in a rendering pipeline which operates at interactive frame rates. Improvement over state-of-the-art view-dependent texture mapping techniques are illustrated on a synthetic scene as well as real imagery of a large scale outdoor scene where large camera calibration and geometric errors are present.

show abstract

“…The advantage over traditional 3D scene model-based rendering is that an exact geometrical description of the scene is not necessary in this approach [13] although approximate geometrical information can be used to improve the results [3,7]. In our lab we have developed an IBR pipeline [9,12], and have recently extended it further to incorporate elements from the work of different authors, such as Buehler [2], Pajarola [15] and Evers-Senne [5]. This extended pipeline is used to create each of the 36 target views of the present site (i.e.…”

Section: Image-based Renderingmentioning

confidence: 99%