Complexity control of HEVC through quadtree depth estimation

Corrêa, Guilherme; Assunção, Pedro; Agostini, Luciano; Cruz, Luís A. da Silva

doi:10.1109/eurocon.2013.6624969

Cited by 7 publications

(4 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A complexity control method of HEVC is proposed in Correa et al [2013] based on a decision algorithm that dynamically adjusts depth range of CUs. The pyramid motion divergence is used to help selecting CU size in Xiong et al [2014], and mode filtering based on texture complexity analysis is used to reduce the number of candidates in Sun et al [2012].…”

Section: Related Workmentioning

confidence: 99%

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

Shen

Zhang

et al. 2015

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

3D High Efficiency Video Coding (3D-HEVC) is an extension of the HEVC standard for coding of multiview videos and depth maps. It inherits the same quadtree coding structure as HEVC for both components, which allows recursively splitting into four equal-sized coding units (CU). One of 11 different prediction modes is chosen to code a CU in inter-frames. Similar to the joint model of H.264/AVC, the mode decision process in HM (reference software of HEVC) is performed using all the possible depth levels and prediction modes to find the one with the least rate distortion cost using a Lagrange multiplier. Furthermore, both motion estimation and disparity estimation need to be performed in the encoding process of 3D-HEVC. Those tools achieve high coding efficiency, but lead to a significant computational complexity. In this article, we propose a fast mode decision algorithm for 3D-HEVC. Since multiview videos and their associated depth maps represent the same scene, at the same time instant, their prediction modes are closely linked. Furthermore, the prediction information of a CU at the depth level X is strongly related to that of its parent CU at the depth level X-1 in the quadtree coding structure of HEVC since two corresponding CUs from two neighboring depth levels share similar video characteristics. The proposed algorithm jointly exploits the inter-view coding mode correlation, the inter-component (texture-depth) correlation and the inter-level correlation in the quadtree structure of 3D-HEVC. Experimental results show that our algorithm saves 66% encoder runtime on average with only a 0.2% BD-Rate increase on coded views and 1.3% BD-Rate increase on synthesized views. . 2015. A 3D-HEVC fast mode decision algorithm for real-time applications.

show abstract

Section: Related Workmentioning

confidence: 99%

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

Shen

Zhang

et al. 2015

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

show abstract

“…Shen et al [ 18 – 20 ] propose fast CU depth estimation and inter mode decision methods by utilizing the spatio-temporal correlations. To achieve better performance when encoding video with fast-motion scenes, Correa et al [ 21 ] propose to estimate the best maximum coding tree depth based on both spatial and temporal correlations observed in the coding tree depths. Although these spatio-temporal based methods perform well when the adjacent blocks belong to the same object, around the boundary areas, it may decrease the coding efficiency since the neighboring CUs are more likely to be encoded with different sizes and prediction modes.…”

Section: Introductionmentioning

confidence: 99%

Decision tree accelerated CTU partition algorithm for intra prediction in versatile video coding

Teng

Xiong

et al. 2021

PLoS ONE

View full text Add to dashboard Cite

Versatile video coding (VVC) achieves enormous improvement over the advanced high efficiency video coding (HEVC) standard due to the adoption of the quadtree with nested multi-type tree (QTMT) partition structure and other coding tools. However, the computational complexity increases dramatically as well. To tackle this problem, we propose a decision tree accelerated coding tree units (CTU) partition algorithm for intra prediction in VVC. Firstly, specially designated image features are extracted to characterize the coding unit (CU) complexity. Then, the trained decision tree is employed to predict the partition results. Finally, based on our newly designed intra prediction framework, the partition process is early terminated or redundant partition modes are screened out. The experimental results show that the proposed algorithm could achieve around 52% encoding time reduction for various test video sequences on average with only 1.75% Bjontegaard delta bit rate increase compared with the reference test model VTM9.0 of VVC.

show abstract

“…Methods in the second category predict the best maximum depth level and the best prediction mode based on both spatial and temporal correlations observed in the coding tree depths. Complexity control methods of HEVC are proposed in [20] based on a decision algorithm that dynamically adjusts the depth range of CUs, and fast CU depth decision methods [21], [22] are proposed by reducing the depth search range based on the depth information correlation between the spatiotemporal adjacent coding tree units and the current coding tree unit. Adaptive CU depth range algorithms are proposed in [23] and [24] to reduce the candidate depth levels, and fast CU decision algorithms are proposed in [25] and [26] to accelerate the coding procedure in either frame level or CU level.…”

mentioning

confidence: 99%

Adaptive Inter-Mode Decision for HEVC Jointly Utilizing Inter-Level and Spatiotemporal Correlations

Shen

Zhang

2014

IEEE Trans. Circuits Syst. Video Technol.

168

View full text Add to dashboard Cite

High Efficiency Video Coding (HEVC) adopts the quadtree structured coding unit (CU), which allows recursive splitting into four equally sized blocks. At each depth level, it enables SKIP mode, merge mode, inter 2N × 2N, inter 2N × N, inter N × 2N, inter 2N × nU, inter 2N × nD, inter nL × 2N, inter nR × 2N, inter N × N (only available for the smallest CU), intra 2N × 2N, and intra N × N (only available for the smallest CU) in inter-frames. Similar to H.264/AVC, the mode decision process in HEVC is performed using all the possible depth levels (or CU sizes) and prediction modes to find the one with the least rate distortion (RD) cost using Lagrange multiplier. This achieves the highest coding efficiency, but leads to a very high computational complexity. Since the optimal prediction mode is highly content dependent, it is not efficient to use all the modes. In this paper, we propose a fast inter-mode decision algorithm for HEVC by jointly using the inter-level correlation of quadtree structure and the spatiotemporal correlation. There exist strong correlations of the prediction mode, the motion vector and RD cost between different depth levels and between spatially temporally adjacent CUs. We statistically analyze the prediction mode distribution at each depth level and the coding information correlation among the adjacent CUs. Based on the analysis results, three adaptive inter-mode decision strategies are proposed including early SKIP mode decision, prediction size correlation-based mode decision and RD cost correlation-based mode decision. Experimental results show that the proposed overall algorithm can save 49%-52% computational complexity on average with negligible loss of coding efficiency, exhibiting applicability to various types of video sequences.

show abstract

Complexity control of HEVC through quadtree depth estimation

Cited by 7 publications

References 8 publications

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

Decision tree accelerated CTU partition algorithm for intra prediction in versatile video coding

Adaptive Inter-Mode Decision for HEVC Jointly Utilizing Inter-Level and Spatiotemporal Correlations

Contact Info

Product

Resources

About