Immersive media experience with MPEG OMAF multi-viewpoints and overlays

Sreedhar, Kashyap Kammachi; Curcio, Igor D. D.; Hourunranta, Ari; Lepistö, Mikael

doi:10.1145/3339825.3393576

Cited by 12 publications

(5 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although 4G LTE can deliver this bandwidth, for a high-definition (HD) video, LTE needs to provide higher throughput and lower latency below 10 and 1-ms jitter per user [57]. Moreover, most of the approaches widely used in the literature to reduce the download bandwidth are analog to the novel solution, namely, the omnidirectional media format (OMAF) [58], established by the Moving Picture Experts Group (MPEG) [59], [60], [61], [62]. However, this latter is not tailored to low latency since the first MPEG-OMAF standard-compliant end-to-end chain for live VR360 [63] showed high E2E delay results of 6s for a 6K × 4K resolution video.…”

Section: Requirements and Challenges In 360mentioning

confidence: 99%

VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

Taleb

Sehad

Nadir

et al. 2023

IEEE Internet Things J.

View full text Add to dashboard Cite

The management of remote services, such as remote surgery, remote sensing, or remote driving, has become increasingly important, especially with the emerging 5G and Beyond 5G technologies. However, the strict network requirements of these remote services represent one of the major challenges that hinder their fast and large-scale deployment in critical infrastructures. This article addresses certain issues inherent in remote and immersive control of virtual reality (VR)-based unmanned aerial vehicles (UAVs), whereby a user remotely controls UAVs, equipped with 360 • cameras, using their head-mounted devices (HMD) and their respective controllers. Remote and immersive control services, using 360 • video streams, require much lower latency and higher throughput for true immersion and high service reliability. To assess and analyze these requirements, this article introduces a real-life testbed system that leverages different technologies (e.g., VR, 360 • video streaming over 4G/5G, and edge computing). In the performance evaluation, different latency types are considered. They are namely: 1) glass-to-glass latency between the 360 • camera of a remote UAV and the HMD display; 2) user/pilot's reaction latency; and 3) the command/execution latency. The obtained results indicate that the responsiveness (dubbed Glass-to-Reaction-to-Execution-GRElatency) of a pilot, using our system, to a sudden event is within an acceptable range, i.e., around 900 ms.

show abstract

Section: Requirements and Challenges In 360mentioning

confidence: 99%

VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

Taleb

Sehad

Nadir

et al. 2023

IEEE Internet Things J.

View full text Add to dashboard Cite

show abstract

“…Omnidirectional imaging systems [16,17] capture different viewing angles over time. Typically, the 360-degree camera is fixed in space, and it captures the world around the camera.…”

Section: Omnidirectional Imagingmentioning

confidence: 99%

Introduction to immersive video technologies

Valenzise¹,

Zerman

Alain

et al. 2023

Immersive Video Technologies

View full text Add to dashboard Cite

“…As an example, a detailed description of Intel's solution for multi-camera virtual reality sports production is available in [12], section D.2. OMAF overlays have been demonstrated together with multiple viewpoints in a city walk use case in [13]. In many productions directors may prescribe the camera switches, but users are given the option to select cameras themselves.…”

Section: A Usage Scenarios For Multiple Viewpointsmentioning

confidence: 99%

Omnidirectional MediA Format (OMAF): Toolbox for Virtual Reality Services

Deshpande¹,

Hannuksela

2021

2021 IEEE Conference on Standards for Communications and Networking (CSCN)

View full text Add to dashboard Cite

This paper provides an overview of the Omnidirectional Media Format (OMAF) standard, second edition, which has been recently finalized. OMAF specifies the media format for coding, storage, delivery, and rendering of omnidirectional media, including video, audio, images, and timed text. Additionally, OMAF supports multiple viewpoints corresponding to omnidirectional cameras and overlay images or video rendered over the omnidirectional background image or video. Many examples of usage scenarios for multiple viewpoints and overlays are described in the paper. OMAF provides a toolbox of features, which can be selectively used in virtual reality services. Consequently, the paper presents the interoperability points specified in the OMAF standard, which enable signaling which OMAF features are in use or required to be supported in implementations. Finally, the paper summarizes which OMAF interoperability points have been taken into use in virtual reality service specifications by the 3 rd Generation Partnership Project (3GPP) and the Virtual Reality Industry Forum (VRIF).

show abstract

Immersive media experience with MPEG OMAF multi-viewpoints and overlays

Cited by 12 publications

References 14 publications

VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

Introduction to immersive video technologies

Omnidirectional MediA Format (OMAF): Toolbox for Virtual Reality Services

Contact Info

Product

Resources

About