A content-based method for perceptually driven joint color/depth compression

Abstract

Multi-view Video plus Depth (MVD) data refer to a set of conventional color video sequences and an associated set of depth video sequences, all acquired at slightly different viewpoints. This huge amount of data necessitates a reliable compression method. However, there is no standardized compression method for MVD sequences. H.264/MVC compression method, which was standardized for Multi many adaptations to MVD. However, it has been shown that MVC is We propose a novel option as for compression of MVD data. consistency. The originality of the proposed method relies on the use of the decoded color data a associated depth compression. This is meant to motivated by previous studies of artifacts occurring in synthesized views: most annoying distortions are located strong depth discontinuities and these distortions are due to misalignment of depth and color edges in decoded images. Thus the method is meant to preserve edges and to ensure consistent localization of color edges and depth edges. To ensure compatibility, colored sequences are encoded with H.264. Depth maps compression image codec, namely LAR (Locally adapted Resolution). It consists in a quad quad-tree representation contributes in the p The adopted strategy is meant to be more perceptually driven than state compared to H.264 encoding of depth images. O method, and visual quality of synthesized views is improved with the proposed approach.

New just-Noticeable-Distortion Model Based on the Depth Information and its Application in Multiview Video Coding

“…In [7], structure similarity and content saliency information was incorporated into the distortion metric, and 10.14% bit rate was saved with similar subjective perception. In [8], a novel depth coding method was proposed. The authors took into consideration the fact that distortion around object edges leads to serious artifacts.…”