Efficient Coding of 360° Videos Exploiting Inactive Regions in Projection Formats

Herglotz, Christian; Jamali, Mohammadreza; Coulombe, Stéphane; Vázquez, Carlos; Vakili, Ahmad

doi:10.1109/icip.2019.8803759

Cited by 7 publications

(12 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [20], Herglotz et al propose to ignore inactive regions in the projection formats during rate-distortion optimization, residual transformation and in-loop filtering. Through this concept, they are able to reach notable rate savings in unpacked projection formats which contain areas that are irrelevant for the spherical representation of the 360-degree video.…”

Section: Related Workmentioning

confidence: 99%

Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding

Andy¹,

Herglotz²,

Schober³

2022

Preprint

Self Cite

View full text Add to dashboard Cite

Inter prediction is one of the key technologies enabling the high compression efficiency of modern video coding standards. 360-degree video needs to be mapped to the 2D image plane prior to coding in order to allow compression using existing video coding standards. The distortions that inevitably occur when mapping spherical data onto the 2D image plane, however, impair the performance of classical inter prediction techniques. In this paper, we propose a motion-plane-adaptive inter prediction technique (MPA) for 360-degree video that takes the spherical characteristics of 360-degree video into account. Based on the known projection format of the video, MPA allows to perform inter prediction on different motion planes in 3D space instead of having to work on the -in theory arbitrarily mapped -2D image representation directly. We furthermore derive a motion-planeadaptive motion vector prediction technique (MPA-MVP) that allows to translate motion information between different motion planes and motion models. Our proposed integration of MPA together with MPA-MVP into the state-of-the-art H.266/VVC video coding standard shows significant Bjøntegaard Delta rate savings of 1.72% with a peak of 3.97% based on PSNR and 1.56% with a peak of 3.40% based on WS-PSNR compared to the VTM-14.2 baseline on average.

show abstract

Section: Related Workmentioning

confidence: 99%

Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding

Andy¹,

Herglotz²,

Schober³

2022

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…In projections with more irregular face shapes, the inactive samples that are used to pad the 2D projected frame to a rectangular shape can be ignored in the rate-distortion optimization, resulting in further compression benefits [76]. A full coding system using a sampling-adjusted CMP is presented in [77], including padding and other techniques to limit face boundary discontinuities such as packing, i.e., reshuffling of the cube faces in the representation so that contiguous objects in the 3D sphere are close in the projected image.…”

Section: Compression and Encodingmentioning

confidence: 99%

A Survey on 360-Degree Video: Coding, Quality of Experience and Streaming

Chiariotti¹

2021

Preprint

View full text Add to dashboard Cite

The commercialization of Virtual Reality (VR) headsets has made immersive and 360 • video streaming the subject of intense interest in the industry and research communities. While the basic principles of video streaming are the same, immersive video presents a set of specific challenges that need to be addressed. In this survey, we present the latest developments in the relevant literature on four of the most important ones: (i) omnidirectional video coding and compression, (ii) subjective and objective Quality of Experience (QoE) and the factors that can affect it, (iii) saliency measurement and Field of View (FoV) prediction, and (iv) the adaptive streaming of immersive 360 • videos.The final objective of the survey is to provide an overview of the research on all the elements of an immersive video streaming system, giving the reader an understanding of their interplay and performance.

show abstract

“…Another application targets video formats with irrelevant content. For example, some projection formats in 360 • video coding map the content to a 2D plane, where parts of the sequence are irrelevant for the reconstruction of the 360 • content [7]. Similar regions can be found in videos generated for video-based point cloud compression [8].…”

mentioning

confidence: 91%

A Low-Parametric Model for Bit-Rate Estimation of VVC Residual Coding

Brand¹,

Herglotz²,

Schober³

2022

Preprint

Self Cite

View full text Add to dashboard Cite

There are many tasks within video compression which require fast bit rate estimation. As an example, rate-control algorithms are only feasible because it is possible to estimate the required bit rate without needing to encode the entire block. With residual coding technology becoming more and more sophisticated, the corresponding bit rate models require more advanced features. In this work, we propose a set of four features together with a linear model, which is able to estimate the rate of arbitrary residual blocks which were compressed using the VVC standard. Our method outperforms other methods which were used for the same task both in terms of mean absolute error and mean relative error. Our model deviates by less than 4 bit on average over a large dataset of natural images.

show abstract

Efficient Coding of 360° Videos Exploiting Inactive Regions in Projection Formats

Cited by 7 publications

References 14 publications

Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding

Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding

A Survey on 360-Degree Video: Coding, Quality of Experience and Streaming

A Low-Parametric Model for Bit-Rate Estimation of VVC Residual Coding

Contact Info

Product

Resources

About