The MPEG Immersive Video Standard—Current Status and Future Outlook

Vadakital, Vinod Kumar Malamal; Dziembowski, Adrian; Lafruit, Gauthier; Thudor, Franck; Lee, Gwangsoon; Alface, Patrice Rondão

doi:10.1109/mmul.2022.3175654

Cited by 24 publications

(8 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Volumetric video technology captures objects and environments in complete 3D [70], enabling viewers to experience 6DoF movement during playback [71,72]. The primary goal of this technology is to deliver a heightened level of realism and immersion in the viewing experience.…”

Section: Volumetric Videomentioning

confidence: 99%

“…These views are then enriched with additional information from other perspectives. The data are intelligently organized into atlases and substantially compressed using a chosen existing 2D video codec [72].…”

Section: Mpeg Immersive Videomentioning

confidence: 99%

“…The chosen format for volumetric videos depends on their application scenarios. For interactive volumetric videos, such as experimental demonstrations or remote surgeries, point cloud compression in V-PCC [135] is preferred because of its ability to support collision detection with 3D geometric shapes [72]. V-PCC specifically processes the point clouds within the user's FoV, leading to a substantial reduction in bandwidth requirements during transmission.…”

Section: Architectural Framework For Video Transmission In Next-gener...mentioning

confidence: 99%

See 2 more Smart Citations

A Survey on Video Streaming for Next-Generation Vehicular Networks

Huang,

Cheng,

Lien

et al. 2024

Electronics

View full text Add to dashboard Cite

As assisted driving technology advances and vehicle entertainment systems rapidly develop, future vehicles will become mobile cinemas, where passengers can use various multimedia applications in the car. In recent years, the progress in multimedia technology has given rise to immersive video experiences. In addition to conventional 2D videos, 360° videos are gaining popularity, and volumetric videos, which can offer users a better immersive experience, have been discussed. However, these applications place high demands on network capabilities, leading to a dependence on next-generation wireless communication technology to address network bottlenecks. Therefore, this study provides an exhaustive overview of the latest advancements in video streaming over vehicular networks. First, we introduce related work and background knowledge, and provide an overview of recent developments in vehicular networking and video types. Next, we detail various video processing technologies, including the latest released standards. Detailed explanations are provided for network strategies and wireless communication technologies that can optimize video transmission in vehicular networks, paying special attention to the relevant literature regarding the current development of 6G technology that is applied to vehicle communication. Finally, we proposed future research directions and challenges. Building upon the technologies introduced in this paper and considering diverse applications, we suggest a suitable vehicular network architecture for next-generation video transmission.

show abstract

Section: Volumetric Videomentioning

confidence: 99%

Section: Mpeg Immersive Videomentioning

confidence: 99%

Section: Architectural Framework For Video Transmission In Next-gener...mentioning

confidence: 99%

See 1 more Smart Citation

A Survey on Video Streaming for Next-Generation Vehicular Networks

Huang,

Cheng,

Lien

et al. 2024

Electronics

View full text Add to dashboard Cite

show abstract

“…Finally, after the pruning operation additional views are packed into atlases as a form of patch mosaic (Fig. 4B and D) [Vad22]. On the decoder side, the atlases are firstly decoded using the typical video decoder (such as VVC).…”

Section: Introductionmentioning

confidence: 99%

Versatile Input View Selection for Efficient Immersive Video Transmission

Klóska¹,

Dziembowski²,

Samelak³

2023

Computer Science Research Notes

View full text Add to dashboard Cite

In this paper we deal with the problem of the optimal selection of input views, which are transmitted within an immersive video bitstream. Due to limited bitrate and pixel rate, only a subset of input views available on the encoder side can be fully transmitted to the decoder. Remaining views are – in the simplest approach – omitted or – in the newest immersive video encoding standard (MPEG immersive video, MIV) – pruned in order to remove less important information. Selecting proper views for transmission is crucial in terms of the quality of immersive video system user’s experience. In the paper we have analyzed which input views have to be selected for providing the best possible quality of virtual views, independently on the viewport requested by the viewer. Moreover, we have proposed an algorithm, which takes into account a non-uniform probability of user’s viewing direction, allowing for the increase of the subjective quality of virtual navigation for omnidirectional content.

show abstract

“…The main concept of the MIV codec for efficiently compressing large 6DoF images involves eliminating the redundancy between multiple-input view videos [13], [14]. In TMIV, the redundant regions between the input view videos are removed, and the remaining regions are segmented into patches that are packed into a small number of atlases, which are then compressed using a conventional 2D codec.…”

mentioning

confidence: 99%

Adaptive Patch-Wise Depth Range Linear Scaling Method for MPEG Immersive Video Coding

Lim,

Kim,

Kim

2023

IEEE Access

View full text Add to dashboard Cite

The Moving Picture Experts Group (MPEG) is responsible for standardizing MPEG immersive video (MIV) for immersive video coding and is involved in research and development focusing on providing six degrees of freedom through a reference software known as the test model for immersive video. To efficiently compress and transmit multiview videos with texture and depth pairings, the encoder part of the MIV codec framework reduces the pixel rate by removing redundancy between views and densely packing the remaining regions into an atlas as patches. The decoder part reconstructs multiview videos from the transmitted atlas to synthesize and render arbitrary viewports, and the depth information has a significant impact on the quality of the rendered viewport. However, the existing method of handling depth values in the MIV codec fails to adequately address the information loss that occurs during quantization or transmission.To preserve and transmit depth information more accurately, we propose a method for expanding the depth dynamic range using min-max linear scaling on a patch-by-patch basis. In addition, we efficiently encode the per-patch minimum and maximum values of depth required by the decoder to recover the original depth values and include them in the metadata. The experimental results indicate that for computer-generated sequences, the proposed method provides PSNR-based Bjøntegaard delta-rate gains of 9.1% and 3.3% in the end-to-end performance for high-and low-bitrate cases, respectively. In addition, subjective quality improvements are observed by reducing the artifacts that primarily occur at the object boundaries in the rendered viewport.INDEX TERMS depth scaling, immersive video, MPEG immersive video, multiview video, virtual reality, 6DoF video I. INTRODUCTION

show abstract

The MPEG Immersive Video Standard—Current Status and Future Outlook

Cited by 24 publications

References 11 publications

A Survey on Video Streaming for Next-Generation Vehicular Networks

A Survey on Video Streaming for Next-Generation Vehicular Networks

Versatile Input View Selection for Efficient Immersive Video Transmission

Adaptive Patch-Wise Depth Range Linear Scaling Method for MPEG Immersive Video Coding

Contact Info

Product

Resources

About