Overview of the Multiview and 3D Extensions of High Efficiency Video Coding

Tech, Gerhard; Chen, Ying; Müller, Karsten; Ohm, Jens-Rainer; Vetro, Anthony; Wang, Ye-Kui

doi:10.1109/tcsvt.2015.2477935

Cited by 380 publications

(183 citation statements)

References 26 publications

Supporting

Mentioning

179

Contrasting

Unclassified

Order By: Relevance

“…Free viewpoint video (FVV) is a novel display format that has evolved from 3D video that enables viewers to watch a scene from any position [1]. This free navigation (FN) experience provides a rich and compelling immersive feeling that is much better than traditional 3D video [2].…”

Section: Introductionmentioning

confidence: 99%

Reliability-Based View Synthesis for Free Viewpoint Video

Deng

Wang

2018

Applied Sciences

View full text Add to dashboard Cite

Featured Application: View synthesis technology is important for free viewpoint video (FVV) and multiview video coding (MVC). It is a practical approach to reduce storage and transmission bandwidth for multiview videos.Abstract: View synthesis is a crucial technique for free viewpoint video and multi-view video coding because of its capability to render an unlimited number of virtual viewpoints from adjacent captured texture images and corresponding depth maps. The accuracy of depth maps is very important to the rendering quality, since depth image-based rendering (DIBR) is the most widely used technology among synthesis algorithms. There are some issues due to the fact that stereo depth estimation is error-prone. In addition, filling occlusions is another challenge in producing desirable synthesized images. In this paper, we propose a reliability-based view synthesis framework. A depth refinement method is used to check the reliability of depth values and refine some of the unreliable pixels, and an adaptive background modeling algorithm is utilized to construct a background image aiming to fill the remaining empty regions after a proposed weighted blending process. Finally, the proposed approach is implemented and tested on test video sequences, and experimental results indicate objective and subjective improvements compared to previous view synthesis methods.

show abstract

Section: Introductionmentioning

confidence: 99%

Reliability-Based View Synthesis for Free Viewpoint Video

Deng

Wang

2018

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…The state-of-the-art 3D video coding standard is the 3D-HEVC [1], which is an extension of the High Efficiency Video Coding (HEVC) standard released in 2015 by the Joint Collaborative Team on 3D Video Coding (JCT-3V). 3D-HEVC is able to reduce significantly the bitrate necessary to represent 3D videos in the MVD format thanks to the addition of several compression tools on top of those already available in HEVC.…”

Section: Introductionmentioning

confidence: 99%

Complexity reduction of 3D-HEVC based on depth analysis for background and ROI classification

Avila

Conceição

Bubolz

et al. 2017

2017 25th European Signal Processing Conference (EUSIPCO)

View full text Add to dashboard Cite

Abstract-The 3D extension of the High Efficiency Video Coding (HEVC) standard achieves large compression rates thanks to the addition of several tools to encode multiview and depth information on top of those available in HEVC. The use of such tools incur in a very large computational demand, which can be a serious problem in power and computationallyconstrained devices and applications. However, not all information contained in an image is fundamental to the viewer, so that different levels of computational effort can be employed when encoding different image regions. The Region of Interest (ROI) concept is used in this work to classify each Coding Unit (CU) as foreground, heterogeneous background and homogeneous background. Then, a simplified encoding process is employed in those regions classified as homogeneous background, terminating earlier the partitioning process in texture CUs, while still still performing the regular decisions in areas classified as ROI. Experimental results show an average reduction of 22.6% in computational complexity for texture coding with negligible or non-perceived image quality degradation.

show abstract

“…XTENSIONS and enhancements to the HEVC standard [1] are developed to support multi-view and 3D video coding [2], scalable coding [3], and coding of high bit-depth videos represented using different color formats. The latter comprises the so-called Range Extensions (RExt) [4].…”

Section: Introductionmentioning

confidence: 99%