An Improved Framework of Affine Motion Compensation in Video Coding

Zhang, Kai; Chen, Yiwen; Zhang, Li; Chien, Wei-Jung; Karczewicz, Marta

doi:10.1109/tip.2018.2877355

Cited by 70 publications

(28 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In Reference [5,[7][8][9], a gradient method is used to estimate the affine motion parameters. This method is based on the Newton-Raphson method, which is a method that allows finding the root of a function with an iterative process.…”

Section: Gradient-based Parameter Estimationmentioning

confidence: 99%

“…As affine motion compensation proved it could achieve significant gains, it has been included in the currently being developed future standard Versatile Video Coding (VVC). Several improvements over the original JEM implementation were proposed [5]. While the original implementation supported only a 4-parameter model, it is possible to allow a 6-parameter model as well and let the encoder decide the best model for each block.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Optical Flow-Based Fast Motion Parameters Estimation for Affine Motion Compensation

et al. 2020

View full text Add to dashboard Cite

This study proposes a lightweight solution to estimate affine parameters in affine motion compensation. Most of the current approaches start with an initial approximation based on the standard motion estimation, which only estimates the translation parameters. From there, iterative methods are used to find the best parameters, but they require a significant amount of time. The proposed method aims to speed up the process in two ways, first, skip evaluating affine prediction when it is likely to bring no encoding efficiency benefit, and second, by estimating better initial values for the iteration process. We use the optical flow between the reference picture and the current picture to estimate quickly the best encoding mode and get a better initial estimation. We achieve a reduction in encoding time over the reference of half when compared to the state of the art, with a loss in efficiency below 1%.

show abstract

Section: Gradient-based Parameter Estimationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Optical Flow-Based Fast Motion Parameters Estimation for Affine Motion Compensation

et al. 2020

View full text Add to dashboard Cite

show abstract

“…VVC, such as more flexible coding partitions [10], advanced intra/inter predictions [11][12][13][14][15][16], as well as advanced transform cores [17] supported for signal energy compaction. Moreover, along with the development of video coding standards, a series of video coding techniques have also been proposed, including extended quad-tree (EQT) [18,19], history-based motion vector predictions [16,20] and cross-component linear model prediction [21,22].…”

Section: Introductionmentioning

confidence: 99%

Low Complexity Quantization in High Efficiency Video Coding

et al. 2020

Self Cite

View full text Add to dashboard Cite

The rate-distortion optimized quantization (RDOQ) provides an excellent trade-off between rate and distortion in High Efficiency Video Coding (HEVC), leading to inspiring improvement in terms of rate-distortion performance. However, its heavy use imposes high complexity on the encoder in realworld video compression applications. In this paper, we provide a comprehensive review on low complexity quantization techniques in HEVC, including both fast RDOQ and all-zero block detection. In particular, the fast RDOQ relies on rate and distortion models for rate-distortion cost estimation, such that the most appropriate quantized coefficient is selected in a low complexity way. All-zero block detection infers the all-zero block by skipping transform and quantization, in an effort to further reduce the complexity. The relationship between the two techniques is also discussed, and moreover, we also envision the future design of low complexity quantization in the upcoming Versatile Video Coding (VVC) standard. INDEX TERMS High efficiency video coding, low complexity video coding, rate-distortion optimized quantization.

show abstract

“…Because the trade-off between the complexity and coding performance is attractive, the scheme in [18] was proposed to JVET [19] and was accepted as one of the core modules of Joint Exploration Model (JEM) [20,21]. After that, Zhang [22] proposed a multi model AMC approach. At the 11th JVET meeting in July 2018, modified AMC of JEM was integrated into VVC and Test Model 2 (VTM2) [5] based on [22].…”

Section: Introductionmentioning

confidence: 99%

“…After that, Zhang [22] proposed a multi model AMC approach. At the 11th JVET meeting in July 2018, modified AMC of JEM was integrated into VVC and Test Model 2 (VTM2) [5] based on [22].…”

Section: Introductionmentioning

confidence: 99%

Design of Efficient Perspective Affine Motion Estimation/Compensation for Versatile Video Coding (VVC) Standard

et al. 2019

View full text Add to dashboard Cite

The fundamental motion model of the conventional block-based motion compensation in High Efficiency Video Coding (HEVC) is a translational motion model. However, in the real world, the motion of an object exists in the form of combining many kinds of motions. In Versatile Video Coding (VVC), a block-based 4-parameter and 6-parameter affine motion compensation (AMC) is being applied. In natural videos, in the majority of cases, a rigid object moves without any regularity rather than maintains the shape or transform with a certain rate. For this reason, the AMC still has a limit to compute complex motions. Therefore, more flexible motion model is desired for new video coding tool. In this paper, we design a perspective affine motion compensation (PAMC) method which can cope with more complex motions such as shear and shape distortion. The proposed PAMC utilizes perspective and affine motion model. The perspective motion model-based method uses four control point motion vectors (CPMVs) to give degree of freedom to all four corner vertices. Besides, the proposed algorithm is integrated into the AMC structure so that the existing affine mode and the proposed perspective mode can be executed adaptively. Because the block with the perspective motion model is a rectangle without specific feature, the proposed PAMC shows effective encoding performance for the test sequence containing irregular object distortions or dynamic rapid motions in particular. Our proposed algorithm is implemented on VTM 2.0. The experimental results show that the BD-rate reduction of the proposed technique can be achieved up to 0.45% and 0.30% on Y component for random access (RA) and low delay P (LDP) configurations, respectively.

show abstract

An Improved Framework of Affine Motion Compensation in Video Coding

Cited by 70 publications

References 18 publications

Optical Flow-Based Fast Motion Parameters Estimation for Affine Motion Compensation

Optical Flow-Based Fast Motion Parameters Estimation for Affine Motion Compensation

Low Complexity Quantization in High Efficiency Video Coding

Design of Efficient Perspective Affine Motion Estimation/Compensation for Versatile Video Coding (VVC) Standard

Contact Info

Product

Resources

About