VVC Subpicture-Based Frame Packing for MPEG Immersive Video

Abstract

The moving picture experts group (MPEG) video coding group started an immersive video coding standard project to accomplish acceptable bandwidth and decoding resources for multiple immersive videos with texture (color) and geometry (depth) information. The MPEG immersive video (MIV) coding standard provides functionality to remove inter-view redundancy and merge the residuals into videos defined as atlases. Although MIV reduces the number of videos to decode, an efficient decoder instance reduction method has not been investigated. This study proposes a frame packing implementation in MIV software. The proposed method conducts frame packing for geometry atlases to align with texture atlases, encodes them as subpicture bitstreams, and merges one texture / geometry atlas into a single bitstream with a bitstream merger. Furthermore, the proposed method provides control over the number of decoder instances without significantly increasing the computational complexity compared to existing frame packing methods. Therefore, the proposed method was accepted in MIV and will be implemented on the recent version of the reference software of MIV.

A Survey on Video Streaming for Next-Generation Vehicular Networks

“…MV-HEVC, as an extension of HEVC, utilizes the established coding techniques of HEVC and introduces multi-view-specific coding methods. However, MV-HEVC faces challenges in handling unstructured multiple videos and ensuring compatibility [146]. These limitations make it less suitable for modern immersive video applications.…”

“…When compared to the Test Model for Immersive Video (TMIV), their proposed method achieves an average savings of 37.26% in the BD rate in terms of the PSNR. Jeong et al [146] introduced a bitstream-merging and geometry-packing algorithm for volumetric video streaming, building on the foundations of MIV and VVC. Their algorithm involves dividing and packing geometry atlases, leading to improvements in Immersive Video-PSNR(IV-PSNR) [92], BD rate gain, and reduced decoding runtime compared to the master profile of MIV.…”

Advanced HEVC Screen Content Coding for MPEG Immersive Video

“…Other MIV-related research regards using existing video encoders for efficient transmission of MIV content, e.g., by including MIV bitstream within HEVC SEI [23], optimization of delta QP between texture and depth [24,25], using the VVC frame packing mechanism [26,27], or using the unmodified HEVC SCC-what was studied by the Authors of this paper in [8].…”