On-the-Fly Processing of Generalized Lumigraphs

Schirmacher, Hartmut; Li, Ming; Seidel, Hans‐Peter

doi:10.1111/1467-8659.00509

Cited by 46 publications

(31 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Since synthesizing a novel view requires only parts of segments in the input images, several systems [23], [26], [27] use the region of interest (ROI) approach to reduce the amount of processed data. We could, for example, partially decode the received JPEG images and only upload the decoded segments to the GPU memory by using the ROI approach.…”

Section: Discussionmentioning

confidence: 99%

“…However, because the cameras cannot be arranged enough densely in practice, we need to estimate the scene geometry (e.g., depth maps) for higher-quality rendering. Schirmacher et al [26] used an array of six FireWire cameras and generated views at 1-2 fps with dense depth maps estimated from the stereo camera pairs, but the rendering quality was limited due to wrong depth reconstruction. Zhang and Chen [27] presented a self-reconfigurable camera array using 48 network cameras, each of which can move sideways and pan using servo motors.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Design and Implementation of a Real-Time Video-Based Rendering System Using a Network Camera Array

Taguchi

Takahashi

Naemura

2009

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYWe present a real-time video-based rendering system using a network camera array. Our system consists of 64 commodity network cameras that are connected to a single PC through a gigabit Ethernet. To render a high-quality novel view, our system estimates a view-dependent per-pixel depth map in real time by using a layered representation. The rendering algorithm is fully implemented on the GPU, which allows our system to efficiently perform capturing and rendering processes as a pipeline by using the CPU and GPU independently. Using QVGA input video resolution, our system renders a free-viewpoint video at up to 30 frames per second, depending on the output video resolution and the number of depth layers. Experimental results show high-quality images synthesized from various scenes.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Design and Implementation of a Real-Time Video-Based Rendering System Using a Network Camera Array

Taguchi

Takahashi

Naemura

2009

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

show abstract

“…In the hardware based approach the proposed solutions use different type of special hardware devices that allow the acquisition of a uniform sampling of the view direction, like computer controlled gantry with planar camera motion ( [2]), camera arrays ( [6], [7], [8], [9]), or camera systems with additional devices (microlens array [10] [11], attenuating mask [12]). …”

Section: Related Workmentioning

confidence: 99%

“…To solve the overdetermined system in Equation 6 we use a Weighted Singular Value Decomposition (SVD) in order to take advantage of the quality information q (j) u,v related to each sample. In this way, we compute a weighted least square solution of the system:…”

Section: Color Residual Fittingmentioning

confidence: 99%

Surface light field from video acquired in uncontrolled settings

Palma

Desogus

Cignoni

et al. 2013

2013 Digital Heritage International Congress (DigitalHeritage)

View full text Add to dashboard Cite

Abstract-This paper presents an algorithm for the estimation of the Surface Light Field using video sequences acquired moving the camera around the object. Unlike other state of the art methods, it does not require a uniform sampling density of the view directions, but it is able to build an approximation of the Surface Light Field starting from a biased video acquisition: dense along the camera path and completely missing in the other directions. The main idea is to separate the estimation of two components: the diffuse color, computed using statistical operations that allow the estimation of a rough approximation of the direction of the main light sources in the acquisition environment; the other residual Surface Light Field effects, modeled as linear combination of spherical functions. From qualitative and numerical evaluations, the final rendering results show a high fidelity and similarity with the input video frames, without ringing and banding effects.

show abstract

“…id. extended LFR with per-pixel depth infornintion computed with a classic stereo algorithm [29]. Their approach allows real-time online view synthesis.…”

Section: Introductionmentioning

confidence: 99%

Group tele-immersion:enabling natural interactions between groups at distant sites.

Yang

Ca)

Nashel

2005

View full text Add to dashboard Cite

LIBRARY VAULTWe present techniques and ;I system for synthesizing views for video teleconferencing between sninll groups. Tn place of replicating one-to-one systems for each pair of users, we create a single unified display of the remote group. Instead of performing dense 3D scene computation, we use more cameras and trade-off storage and hardware for computation. While it is expensive to directly capture a scene from all possible viewpoints, we have observed that the participants' viewpoints LISLI;III~ remain at ;I constant height (eye level) during video teleconferencing. Therefore, we can restrict the possible viewpoint to be within a virtual plane without sacrificing much of the realism, and in cloing so we significantly reduce the numher of required cameras. Rued on this observation, we hove cleveloped a technique that uses light-field style rendering to giiarantee the cliiality of the synthesized views. using a linear array of calneras with a life-sized, projected display. Our full-duplex prototype system between Sruiclia National Laboratories, California and the University of North Carolina at Chapel Hill has been able to synthesize photo-realistic views at interactive rates, and has been used to video conference cluring regular meetings between the sites. 3This page intentionally left blank.4

show abstract

On-the-Fly Processing of Generalized Lumigraphs

Cited by 46 publications

References 23 publications

Design and Implementation of a Real-Time Video-Based Rendering System Using a Network Camera Array

Design and Implementation of a Real-Time Video-Based Rendering System Using a Network Camera Array

Surface light field from video acquired in uncontrolled settings

Group tele-immersion:enabling natural interactions between groups at distant sites.

Contact Info

Product

Resources

About