Deep compression for streaming texture intensive animations

Abstract

This paper presents a streaming technique for synthetic texture intensive 3D animation sequences. There is a short latency time while downloading the animation, until an initial fraction of the compressed data is read by the client. As the animation is played, the remainder of the data is streamed online seamlessly to the client. The technique exploits frame-to-frame coherence for transmitting geometric and texture streams. Instead of using the original textures of the model, the texture stream consists of view-dependent textures which are generated by rendering offline nearby views. These textures have a strong temporal coherency and can thus be well compressed. As a consequence, the bandwidth of the stream of the view-dependent textures is narrow enough to be transmitted together with the geometry stream over a low bandwidth network. These two streams maintain a small online cache of geometry and view-dependent textures from which the client renders the walkthrough sequence in real-time. The overall data transmitted over the network is an order of magnitude smaller than an MPEG postrendered sequence with an equivalent image quality.

Multi-view coding for image-based rendering using 3-d scene geometry

“…This paper describes two different ways in which knowledge of scene geometry can be employed to encode multi-view imagery. In texture-based coding, scene geometry is used to convert images to view-dependent texture maps prior to compression [5], [23], [24], [8], [25]. These view-dependent texture maps exhibit greater inter-map correlation than the original images, making them more amenable to coding.…”

Attention guided MPEG compression for computer animations

“…To fill those gaps, only the pixels that cover the gaps are sent to the client every frame. Using such approach, Cohen-Or et al [1999] reported a reduction of the bit-stream size up to a few percent of a corresponding MPEG-2 stream. However the result did not take into account the transfer of geometry, which had to be available both for the server and the client.…”

Bandwidth Reduction Techniques for Remote Navigation Systems

“…This way they achieve reduction ratios of 55% on small movements of the camera. Cohen-Or et al [8] use a compression scheme which reduces up to one order of magnitude the bandwidth, compared to a MPEG postrendered sequence with equivalent quality. Their compression scheme requires also that the client has access to the geometric data and exploit spatial coherence in order to improve compression ratios.…”