Fast CU Partitioning Algorithm for H.266/VVC Intra-Frame Coding

Fu, Ting; Zhang, Hao; Mu, Fan; Chen, Huanbang

doi:10.1109/icme.2019.00018

Cited by 96 publications

(86 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[ [21][22][23] are the state-of-the-art techniques dealing with the QTMT issue. [21] adopts the Bayesian decision rule to eliminate the redundant selection of QTMT. The split types and intra prediction modes of sub-CUs are adopted as the input features.…”

Section: B Methods For Qtbt and Qtmtmentioning

confidence: 99%

“…In part II.A, approaches applied to the complexity reduction of HEVC QT structure are presented [4][5][6][7][8][9][10][11][12][13][14][15][16][17][18]. In part II.B, existing state-of-the-art QTBT and QTMT intra partition methods dealing with the novel asymmetric partition issue are concluded [19][20][21][22][23].…”

Section: Related Workmentioning

confidence: 99%

“…Since the first decisive JVET conference on VVC in 2018, few adaptive algorithms have been proposed to speed up the QTMT intra prediction. As aforementioned, there is a Bayesian method in [21], a decision tree method in [22] and a CNN method in [23] to our knowledge up to now. Although machine learning and neural network methods are becoming increasingly popular in recent years in solving problems in image processing and video coding field, we cannot deny that traditional methods such as variance-based or gradient-based are also preferred.…”

Section: Motivationmentioning

confidence: 99%

See 2 more Smart Citations

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

et al. 2020

View full text Add to dashboard Cite

Different from the traditional quaternary tree (QT) structure utilized in the previous generation video coding standard H.265/HEVC, a brand new partition structure named quadtree with nested multi-type tree (QTMT) is applied in the latest codec H.266/VVC. The introduction of QTMT brings in superior encoding performance at the cost of great time-consuming. Therefore, a fast intra partition algorithm based on variance and Sobel operator is proposed in this paper. The proposed method settles the novel asymmetrical partition issue in VVC by well balancing the reduction of computational complexity and the loss of encoding quality. To be more concrete, we first terminate further splitting of a coding unit (CU) when the texture of it is judged as smooth. Then, we use Sobel operator to extract gradient features to decide whether to split this CU by QT, thus terminating further MT partitions. Finally, a completely novel method to choose only one partition from five QTMT partitions is applied. Obviously, homogeneous area tends to use a larger CU as a whole to do prediction while CUs with complicated texture are prone to be divided into small sub-CUs and these sub-CUs usually have different textures from each other. We calculate the variance of variance of each sub-CU to decide which partition will distinguish the sub-textures best. Our method is embedded into the latest VVC official reference software VTM-7.0. Comparing to anchor VTM-7.0, our method saves the encoding time by 49.27% on average at the cost of only 1.63% BDBR increase. As a traditional scheme based on variance and gradient to decrease the computational complexity in VVC intra coding, our method outperforms other relative existing state-of-the-art methods, including traditional machine learning and convolution neural network methods. INDEX TERMS Asymmetric block size, fast partition decision, intra prediction, quadtree with multi-type tree, versatile video coding YIBO FAN received the B.E. degree in electronics and engineering from

show abstract

Section: B Methods For Qtbt and Qtmtmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Motivationmentioning

confidence: 99%

See 1 more Smart Citation

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

et al. 2020

View full text Add to dashboard Cite

show abstract

“…1 shows the result of CU division in a CTU. The CUs are first split into sub-CUs through QT structure and each sub-CU can continue to divide smaller CUs according to the CU partition rule until reaching the predefined maximum depth of each splitting structure [14]. The QTMT partitioning structure can produce a better coding shape than HEVC, which can improve the compression rate.…”

Section: Related Workmentioning

confidence: 99%

Fast CU Partition Decision Method Based on Texture Characteristics for H.266/VVC

et al. 2020

View full text Add to dashboard Cite

“…As explained before, in this paper, the VVC standard is used to encode the video contents. The VVC standard adopts the block-based hybrid video coding structure and utilizes a QuadTree with a nested Multi-Type tree coding (QTMT) block structure [16]. Figure 3 shows the block partitioning in the VVC standard.…”

Section: Bit Allocation Algorithmmentioning

confidence: 99%

A Novel Two-Level Rate Control Algorithm Based on Visual Attention for 360-Degree Video for Versatile Video Coding Standard

Roodaki¹

2020

Preprint

View full text Add to dashboard Cite

360-degree video is providing users with an interactive experience to explore the scenes freely. But, because only a small portion of the entire video, called viewport, is watched at every point in time, transmitting the entire video is bandwidth-consuming. Since, the perceptual quality of such video mainly depends on the quality of the viewport, more bandwidth should be assigned to these important parts of the scene. Hence, understanding how people observe and explore 360-degree content is essential. In this paper, we propose a new Two-level rate control algorithm which tries to allocate more bits for encoding the viewport parts of a 360-degree video. The head and eye movements of the observers is used to investigate the visual attention of people to detect the viewports. Then, a Coding Tree Unit (CTU) level rate assignment approach is proposed to assign a proper number of bits to each CTU of the viewport and non-viewport parts. It is assumed that higher motion complexity results in higher bitrates of the encoded video. So, we propose to assign the proper number of bits to each CTU according to its motion complexity. Another novel part of our proposed approach is proposing a new metric to parameterize the motion complexity of each CTU using the high-order motion models in Versatile Video Coding (VVC) standard. Experimental results show that our proposed rate control, on average, achieves 58.27% reduction in bitrate in the Bjøntegaard-Bitrate scales, compared to the standard VCC standard. Furthermore, the proposed scheme provides a significantly better subjective viewing quality compared to the-state-of-the-art methods.

show abstract

Fast CU Partitioning Algorithm for H.266/VVC Intra-Frame Coding

Cited by 96 publications

References 5 publications

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

Fast CU Partition Decision Method Based on Texture Characteristics for H.266/VVC

A Novel Two-Level Rate Control Algorithm Based on Visual Attention for 360-Degree Video for Versatile Video Coding Standard

Contact Info

Product

Resources

About