View Synthesis Distortion Estimation for AVC- and HEVC-Compatible 3-D Video Coding

Oh, Byung Tae; Oh, Kwan‐Jung

doi:10.1109/tcsvt.2013.2290577

Cited by 34 publications

(12 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Assume that vi is the depth level of a pixel i and D(·) is the disparity function of the depth level. Then, the disparity that is induced by vi can be expressed as follows [9]…”

Section: Preliminariesmentioning

confidence: 99%

Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

Gao

Özçinar

Smolić

2018

2018 25th IEEE International Conference on Image Processing (ICIP)

View full text Add to dashboard Cite

The optimization of occlusion-inducing depth pixels in depth map coding has received little attention in the literature, since their associated texture pixels are occluded in the synthesized view and their effect on the synthesized view is considered negligible. However, the occlusion-inducing depth pixels still need to consume the bits to be transmitted, and will induce geometry distortion that inherently exists in the synthesized view. In this paper, we propose an efficient depth map coding scheme specifically for the occlusion-inducing depth pixels by using allowable depth distortions. Firstly, we formulate a problem of minimizing the overall geometry distortion in the occlusion subject to the bit rate constraint, for which the depth distortion is properly adjusted within the set of allowable depth distortions that introduce the same disparity error as the initial depth distortion. Then, we propose a dynamic programming solution to find the optimal depth distortion vector for the occlusion. The proposed algorithm can improve the coding efficiency without alteration of the occlusion order. Simulation results confirm the performance improvement compared to other existing algorithms.

show abstract

“…Assume that vi is the depth level of a pixel i and D(·) is the disparity function of the depth level. Then, the disparity that is induced by vi can be expressed as follows [9]…”

Section: Preliminariesmentioning

confidence: 99%

Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

Gao

Özçinar

Smolić

2018

2018 25th IEEE International Conference on Image Processing (ICIP)

View full text Add to dashboard Cite

show abstract

“…A closed-form model utilizing the correlation coefficient is proposed. The distortion model proposed in [13] has been used in [14] for Advanced Video Coding (AVC)/High Efficiency Video Coding (HEVC)-compatible 3-D video codecs.…”

Section: ) Source-coding-caused Synthesis Distortion Estimationmentioning

confidence: 99%

“…We first apply the RODE method to both the reference depth and texture images to obtain the PMF at each pixel location. If the general view synthesis algorithm is used, the reference depth pixel PMF is then used to calculate the PD w (i) (d l ) in (14) and the hole probability in (13) based on the graphical model. The moments in (14) thus become…”

Section: Recursive Optimal Distortion Estimation and Integration Wmentioning

confidence: 99%

View Synthesis Distortion Estimation With a Graphical Model and Recursive Calculation of Probability Distribution

Zhang

Liang

2015

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

Depth-image-based rendering (DIBR) is frequently used in multiview video applications such as free-viewpoint television. In this paper, we consider the two DIBR algorithms used in the Moving Picture Experts Group view synthesis reference software, and develop a scheme for the encoder to estimate the distortion of the synthesized virtual view at the decoder when the reference texture and depth sequences experience transmission errors such as packet loss. We first develop a graphical model to analyze how random errors in the reference depth image affect the synthesized virtual view. The warping competition rule adopted in the DIBR algorithms is explicitly represented by the graphical model. We then consider the case where packet loss occurs to both the encoded texture and depth images during transmission and develop a recursive optimal distribution estimation (RODE) method to calculate the per-pixel texture and depth probability distributions in each frame of the reference views. The RODE is then integrated with the graphical model method to estimate the distortion in the synthesized view caused by packet loss. Experimental results verify the accuracy of the graphical model method, the RODE, and the combined estimation scheme.Index Terms-Distortion estimation, graphical model, multiview videos, recursive probability mass function (PMF), view synthesis.

show abstract

“…This kind of scene representation enables a receiver to generate virtual views by using depth image based rendering (DIBR) techniques [Oh and Oh 2014]. It is known to be both bandwidth efficient and backward compatible with legacy displays.…”

Section: Introductionmentioning

confidence: 99%

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

Shen

Zhang

et al. 2015

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

3D High Efficiency Video Coding (3D-HEVC) is an extension of the HEVC standard for coding of multiview videos and depth maps. It inherits the same quadtree coding structure as HEVC for both components, which allows recursively splitting into four equal-sized coding units (CU). One of 11 different prediction modes is chosen to code a CU in inter-frames. Similar to the joint model of H.264/AVC, the mode decision process in HM (reference software of HEVC) is performed using all the possible depth levels and prediction modes to find the one with the least rate distortion cost using a Lagrange multiplier. Furthermore, both motion estimation and disparity estimation need to be performed in the encoding process of 3D-HEVC. Those tools achieve high coding efficiency, but lead to a significant computational complexity. In this article, we propose a fast mode decision algorithm for 3D-HEVC. Since multiview videos and their associated depth maps represent the same scene, at the same time instant, their prediction modes are closely linked. Furthermore, the prediction information of a CU at the depth level X is strongly related to that of its parent CU at the depth level X-1 in the quadtree coding structure of HEVC since two corresponding CUs from two neighboring depth levels share similar video characteristics. The proposed algorithm jointly exploits the inter-view coding mode correlation, the inter-component (texture-depth) correlation and the inter-level correlation in the quadtree structure of 3D-HEVC. Experimental results show that our algorithm saves 66% encoder runtime on average with only a 0.2% BD-Rate increase on coded views and 1.3% BD-Rate increase on synthesized views. . 2015. A 3D-HEVC fast mode decision algorithm for real-time applications.

show abstract

View Synthesis Distortion Estimation for AVC- and HEVC-Compatible 3-D Video Coding

Cited by 34 publications

References 15 publications

Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

View Synthesis Distortion Estimation With a Graphical Model and Recursive Calculation of Probability Distribution

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

Contact Info

Product

Resources

About