Recent Advances on HEVC Inter-Frame Coding: From Optimization to Implementation and Beyond

Abstract

High Efficiency Video Coding (HEVC) has doubled the video compression ratio with equivalent subjective quality as compared to its predecessor H.264/AVC. The significant coding efficiency improvement is attributed to many new techniques. Interframe coding is one of the most powerful yet complicated techniques therein and has posed high computational burden thus main obstacle in HEVC-based real-time applications. Recently, plenty of research has been done to optimize the inter-frame coding, either to reduce the complexity for real-time applications, or to further enhance the encoding efficiency. In this paper, we provide a comprehensive review of the state-of-the-art techniques for HEVC inter-frame coding from three aspects, namely fast inter coding solutions, implementation on different hardware platforms as well as advanced inter coding techniques. More specifically, different algorithms in each aspect are further subdivided into sub-categories and compared in terms of pros, cons, coding efficiency and coding complexity. To the best of our knowledge, this is the first such comprehensive review of the recent advances of the inter-frame coding for HEVC and hopefully it would help the improvement, implementation and applications of HEVC as well as the ongoing development of the next generation video coding standard.

Development of a Modified Method of Network Traffic Forming

“…Estimating the self-similar properties of video traffic over large intervals using the R/S analysis method has advantages over other methods of estimating self-similarity. The R/S analysis functions themselves exhibit a scaling property and therefore constitute an optimal reference point system on which to track large-scale phenomena [18,19].…”

Scene Matters: Model-based Deep Video Compression

“…Traditional video coding methods mainly follow hybrid video coding framework by improving various coding tools e.g., short-distance intra prediction [26], affine motion estimation [12] and low-rank in-loop filter [27]. However, these coding tools are designed so delicately that the traditional coding framework faces performance bottleneck [28]. Deep learning technique has also been applied to improve video coding performance, and achieved great progress in recent years.…”

Image and Video Coding Techniques for Ultra-low Latency

“…Another acceleration strategy is to oload the full inter prediction step, or a part of it, to a GPU [53,58,134] or an FPGA [10,12]. A comprehensive review by Zhang et al [164] covers literature on inter prediction of HEVC up to the year 2019.…”