Voxelvideos for Entertainment, Education, and Training

Abstract

Volumetric videos allow for a true three-dimensional experience where users can freely choose their viewing angles and be actually immersed in a video clip. High quality video productions are gaining attention and first volumetric video recordings are commercially provided at select places. Unfortunately, the production process is very time, labour, and technology-resource intensive, which requires specialist hardware, software, and production experts. A "youtube-like" production, distribution, and experience system would be desirable. Here we present an approach which allows for the creation and interactive replay of three-dimensional videoclips using a novel voxel-based platform-voxelvideos. We can show that our voxelvideos experienced in virtual and augmented reality are effective, enjoyable, and perceived as useful. We hope that our approach and findings will encourage researchers, media experts, and hobbyists to experiment with voxelvideos as a new form of affordable media production and experience.INDEX TERMS volumetric video, real-time, 3D video capture, 3D reconstruction, voxels

Wish You Were Here: Mental and Physiological Effects of Remote Music Collaboration in Mixed Reality

“…Reconstruction of sensor data in the remote user environment can be achieved by rendering voxels on HMDs as encouraged by Regenbrecht et al, who also demonstrated real-time applications [76]. This approach has also been used to playback immersive 3D videos [75] or for interacting with reconstructed environments [53]. Schlagowski et al proposed a similar reconstruction of 3D sensor data as an overlay for pass-through AR based on their findings from interviewing musicians in focus groups [82].…”

Ātea Presence— Enabling Virtual Storytelling, Presence, and Tele-Co-Presence in an Indigenous Setting

“…These voxelvideos (c.f. Regenbrecht et al, 2021) allow for a coarse "holographic" in-space visualisation of a storyteller, including a spatial audio rendering, with the aim of giving the impression of a person being co-present in the same space with the user.…”