Selective Pixel Transmission for Navigating in Remote Virtual Environments

Abstract

This paper presents a technique to improve the performance of a walkthrough in remote virtual environments, where a scene is rendered jointly by the server and the client, in order to reduce the network requirements as much as possible. The client generates novel views by extrapolating a reference view based on the locally available geometric model, while the server transmits data necessary to prevent an accumulation of errors. Within this concept, we show that by transmitting only a selected subset of pixels, the quality of the extrapolated views can be improved while requiring less bandwidth. We focus on the selection process in which the visibility gaps between the reference view and novel view are detected, packed and transmitted compressed to the client.

Edgebreaker: connectivity compression for triangle meshes

“…In many of these applications, human productivity or satisfaction would be significantly enhanced by the possibility of an immediate access to remotely located 3D data sets for visual inspection or manipulation. Even when image-based rendering [21,20,5] and progressive transmission techniques [12,14] for adaptive resolution graphics are used to reduce the fraction of the 3D representation that must be transferred at any given time, geometry transfer remains the bottleneck. The anticipated phone and network bandwidth increases will not, by themselves, suffice to offset the explosion of the complexity and popularity of 3D models.…”

Tessellated Shading Streaming

“…This fact can be exploited as the static geometry can be used directly for perspective texture mapping, optionally with further simplification [RKR∗16]. Keeping the full model data on client and server allows to reduce transmission only to images after factoring in low‐frequency illumination [Lev95], disocclusions [MC097] or removing complex indirect illumination effects [CLM∗15].…”

Attention guided MPEG compression for computer animations

“…Another approach to streaming computer animations involves warping reference images on the client-side [CohenOr et al 1999;Mann and Cohen-Or 1997]. A client, based on geometry information and a reference image, renders several consecutive frames without actually downloading those frames from the server.…”