3D video coding using the synthesized view distortion change

Abstract

In 3D video, texture and supplementary depth data are coded to enable the interpolation of a required number of synthesized views for multi-view displays in the range of the original camera views. The coding of the depth data can be improved by analyzing the distortion of synthesized video views instead of the depth map distortion. Therefore, this paper introduces a new distortion metric for 3D video coding, which relates changes in the depth map directly to changes of the overall synthesized view distortion. It is shown how the new metric can be integrated into the rate-distortion optimization (RDO) process of an encoder, that is based on high-efficiency video coding technology. An evaluation of the modified encoder is conducted using different view synthesis algorithms and shows about 50% rate savings for the depth data or 0.6 dB PSNR gains for the synthesized view

Adaptive delivery of immersive 3D multi-view video over the Internet

“…However, other perceptual quality metrics (e.g., Synthesized View Distortion Change (SVDC) [67], Structural SIMilarity (SSIM) [68], Spatial Peak Signal to Perceptual-Noise Ratio (SPSPNR) [69]) are equally compatible with the proposed system.…”

Depth map compression via 3D region-based representation

“…The main advantage of modeling the coding error on the synthesized view instead of calculating it on the depth map is that the impact of the coding errors can be determined in the generated virtual view. Moreover, in [40], a new distortion metric is proposed to measure the influence of depth errors in the synthesized virtual view.…”

Analysis of the Encoding Efficiency of 3D HEVC

“…In the View Synthesis Optimization, D is measured exactly with synthesized views distortion change (SVDC) [12] related to distortion of depth maps by fast rendering mechanism called renderer model.…”