Towards A Live Software Decoder Implementation For The Upcoming Versatile Video Coding (VVC) Codec

Wieckowski, Adam; Hege, Gabriel; Bartnik, Christian; Lehmann, Christian W.; Stoffers, Christian; Bross, Benjamin; Marpe, Detlev

doi:10.1109/icip40778.2020.9191199

Cited by 50 publications

(33 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A proof-of-concept 4K real-time hardware VVC decoder was already shown [46] and still unreleased OpenVVC was used in the UHD video demonstration [47]. A VLC player plugin called O266dec [48], [49] and Fraunhofer VVdeC [50], [51] are two practical VVC decoder software implementations that include multiple levels of parallelization.…”

Section: B Prospective Real-time Vvc Video Codecsmentioning

confidence: 99%

Comparative Rate-Distortion-Complexity Analysis of VVC and HEVC Video Codecs

et al. 2021

View full text Add to dashboard Cite

Versatile Video Coding (VVC/H.266) is the next-generation international video coding standard and a successor to the widespread High Efficiency Video Coding (HEVC/H.265). This paper analyzes the rate-distortion-complexity characteristics of the VVC reference software (VTM10.0) by using HEVC reference software (HM16.22) as an anchor. In this independent study, the rate-distortion performance of VTM was benchmarked against HM with the objective PSNR, SSIM, and VMAF quality metrics and the associated encoder and decoder complexities were profiled at function level using Intel VTune Profiler on Intel Xeon E5-2699 v4 22-core processors. For a fair comparison, all our experiments were conducted under the VTM common test conditions (CTC) that define 10-bit configurations of the VTM codec for the addressed All Intra (AI), Random Access (RA), and Low Delay B (LB) conditions. The VTM CTC test set was also extended with complementary 4K UHD sequences to elaborate RD characteristics with higher resolutions. According to our evaluations, VTM improves the average coding efficiency over HM, depending on quality metric, by 23.0-23.9% under the AI condition, 33.1-36.6% under the RA condition, and 26.7-29.5% under the LB condition. However, the coding gain of VTM comes with 34.0×, 8.8×, and 7.5× encoding complexity over that of HM under the AI, RA, and LB conditions, respectively. The corresponding overhead of the VTM decoder stays steady at 1.8× across all conditions. This study also pinpoints the most complex parts of the VTM codec and discusses practical implementation aspects of prospective real-time VVC encoders and decoders.INDEX TERMS Common test conditions (CTC), HEVC test model (HM), High Efficiency Video Coding (HEVC), objective quality analysis, performance profiling, rate-distortion-complexity (RDC), UVG dataset, Versatile Video Coding (VVC), video codec, VVC test model (VTM). I. INTRODUCTIONUR society is surrounded by a myriad of media applications where digital video is of the essence. According to Cisco, the global IP video traffic will increase fourfold from 2017 and account for 82% of all IP traffic by 2022 [1]. Moreover, Comcast estimates that the prevailing COVID-19 crisis has increased Voice over Internet Protocol (VoIP) and videoconferencing by 210-285% and other video consumption by 20-40% over that of the prepandemic period [2]. This snowballing growth is mainly driven by the omnipresent connectivity and proliferation of advanced multimedia solutions that support emerging bandwidth-greedy formats like 4K/8K Ultra High Definition (UHD) or 360-degree omnidirectional videos.

show abstract

Section: B Prospective Real-time Vvc Video Codecsmentioning

confidence: 99%

Comparative Rate-Distortion-Complexity Analysis of VVC and HEVC Video Codecs

et al. 2021

View full text Add to dashboard Cite

show abstract

“…Compared to VTM, the optimized encoder implementation in [23] features additional SIMD code, mostly ported from [17], as well as structural improvements. In Fig.…”

Section: Profiling Resultsmentioning

confidence: 99%

VVC Complexity and Software Implementation Analysis

Bossen¹,

Sühring

Wieckowski

et al. 2021

IEEE Trans. Circuits Syst. Video Technol.

Self Cite

View full text Add to dashboard Cite

A steady increase in available processing power continues to drive advances in video compression technology. The recently completed Versatile Video Coding (VVC) standard aims to double the compression efficiency of HEVC and deliver a same quality of video at half the bitrate. To achieve this goal, VVC includes several new methods that improve coding efficiency at the cost of increased complexity. This paper provides a complexity analysis of VVC and its VTM reference software. Whereas VVC is more complex than HEVC, it remains readily implementable in software on current generation processors. Performance of practical decoders are reported, showing that real-time decoding of 8K content is feasible. An encoder is also presented, showing that most of the compression gains of VVC over HEVC can be obtained at a small fraction of the resources needed by the VTM encoder under common test conditions.

show abstract

“…HEVC, which is still not fully supported by most devices, provides a maximum 8K of resolution and 120 FPS whereas AVC provides only a maximum 4K resolution and 60 FPS. Versatile Video Coding (VVC), the successor of HEVC, provides up to 50% of bitrate reduction with an increase in the computational complexity [6].…”

Section: B Solutions and Research Directionsmentioning

confidence: 99%

Extremely Interactive and Low-Latency Services in 5G and Beyond Mobile Systems

Taleb

Nadir

Flinck

et al. 2021

IEEE Comm. Stand. Mag.

View full text Add to dashboard Cite

This paper provides an overview of extremelyinteractive and low latency immersive services as well as on the relevant industry and standardization activities. Immersive services immerse a viewer or the viewed digital objects into an environment that is either real, virtual or a mixture of both. The applications are accordingly named as Virtual Reality, Augmented Reality, Extended Reality, and Holography applications. These applications benefit from the ongoing advances in user interfaces, computing technologies, and networking technologies. Such applications are expected to generate most of the traffic in the next generation networks, particularly 6G networks. In this paper, the main relevant use cases are introduced along with their respective requirements. The paper also provides insights on the relevant architectures and solutions, and highlights some research challenges and directions.

show abstract

Towards A Live Software Decoder Implementation For The Upcoming Versatile Video Coding (VVC) Codec

Cited by 50 publications

References 14 publications

Comparative Rate-Distortion-Complexity Analysis of VVC and HEVC Video Codecs

Comparative Rate-Distortion-Complexity Analysis of VVC and HEVC Video Codecs

VVC Complexity and Software Implementation Analysis

Extremely Interactive and Low-Latency Services in 5G and Beyond Mobile Systems

Contact Info

Product

Resources

About