The making of welcome to light fields VR

Overbeck, Ryan S.; Erickson, Daniel; Evangelakos, Daniel; Debevec, Paul

doi:10.1145/3214745.3214811

Cited by 11 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The disk-blending method was implemented similarly to the "Welcome to Light Fields" application (Overbeck et al, 2018b). The disk is effectively an oval shape with four half-axes of different lengths, which extend to the center of the neighboring disk for optimal capture volume coverage.…”

Section: Light Field Renderingmentioning

confidence: 99%

“…The main difference is that a large variety of perspectives are being captured, leading to a bigger volume inside which new perspective views can be computed. One prominent example is Google's "Welcome to Light Fields" application for VR headsets and their rotating multi-camera rig (Overbeck et al, 2018b). In this case, camera placement on the arc defines future light field viewing volume.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Development and user evaluation of an immersive light field system for space exploration

Goriachev,

Kuula,

Tikka

et al. 2024

Front. Virtual Real.

View full text Add to dashboard Cite

This paper presents the developmental work and user evaluation results of an immersive light field system built for the European Space Agency’s (ESA) project called “Light field-enhanced immersive teleoperation system for space station and ground control.” The main aim of the project is to evaluate the usefulness and feasibility of light fields in space exploration, and compare it to other types of immersive content, such as 360° photos and point clouds. In the course of the project, light field data were captured with a robotically controlled camera and processed into a suitable format. The light field authoring process was performed, and a light field renderer capable of displaying immersive panoramic or planar light fields on modern virtual reality hardware was developed. The planetary surface points of interest (POIs) were modeled in the laboratory environment, and three distinct test use cases utilizing them were developed. The user evaluation was held in the European Astronaut Centre (EAC) in the summer of 2023, involving prospective end-users of various backgrounds. During the evaluation, questionnaires, interviews, and observation were used for data collection. At the end of the paper, the evaluation results, as well as a discussion about lessons learned and possible improvements to the light field system, are presented.

show abstract

Section: Light Field Renderingmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Development and user evaluation of an immersive light field system for space exploration

Goriachev,

Kuula,

Tikka

et al. 2024

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…Rendering realistic images for virtual worlds is a key objective in many computer vision and graphics tasks (Huo and Yoon 2021;Xu et al 2022;Huang et al 2023;Li, Ngo, and Nagahara 2023), with applications in animation production (Dahlberg, Adler, and Newlin 2019), VR/AR world generation (Overbeck et al 2018), virtual dataset synthesis (Ge et al 2022), etc. One widely used technique for this purpose is Monte Carlo (MC) sampling (Seila 1982), which is highly versatile but typically requires a large number of samples to achieve accurate results.…”

Section: Introductionmentioning

confidence: 99%

High-Quality Real-Time Rendering Using Subpixel Sampling Reconstruction

Zhang,

Yuan

2024

AAAI

View full text Add to dashboard Cite

Generating high-quality, realistic rendering images for real-time applications generally requires tracing a few samples-per-pixel (spp) and using deep learning-based approaches to denoise the resulting low-spp images. Existing denoising methods necessitate a substantial time expenditure when rendering at high resolutions due to the physically-based sampling and network inference time burdens. In this paper, we propose a novel Monte Carlo sampling strategy to accelerate the sampling process and a corresponding denoiser, subpixel sampling reconstruction (SSR), to obtain high-quality images. Extensive experiments demonstrate that our method significantly outperforms previous approaches in denoising quality and reduces overall time costs, enabling real-time rendering capabilities at 2K resolution.

show abstract

“…Single scan swept paths using e.g. GoPros [4] also provide a low cost and simple usage, but require custom constructions and only deal with static scenes. More involved multi stereo pairs [5] and large camera arrays [6], can be highly complex and costly requiring special purpose ingest hardware assembly and calibration, with custom synchronization and machine vision components.…”

Section: Introductionmentioning

confidence: 99%

Light Field Synthesis Using Inexpensive Surveillance Camera Systems

Dümbgen

Schroers

Mitchell

2019

2019 IEEE International Conference on Image Processing (ICIP)

View full text Add to dashboard Cite

We present a light field synthesis technique that achieves accurate reconstruction given a low-cost, wide-baseline camera rig. Our system integrates optical flow with methods for rectification, disparity estimation, and feature extraction, which we then feed to a neural network view synthesis solver with wide-baseline capability. We propose two novel warping methods that improve the accuracy of disparity estimation and view synthesis. The methods enable the use of offthe-shelf surveillance camera hardware in a simplified and expedited capture workflow. A thorough analysis of the process and resulting view synthesis accuracy over state of the art is provided.

show abstract

The making of welcome to light fields VR

Cited by 11 publications

References 5 publications

Development and user evaluation of an immersive light field system for space exploration

Development and user evaluation of an immersive light field system for space exploration

High-Quality Real-Time Rendering Using Subpixel Sampling Reconstruction

Light Field Synthesis Using Inexpensive Surveillance Camera Systems

Contact Info

Product

Resources

About