HEVC tile based streaming to head mounted displays

Skupin, Robert; Sánchez, Yago; Podborski, Dimitri; Hellge, Cornelius; Schierl, Thomas

doi:10.1109/ccnc.2017.7983191

Cited by 27 publications

(10 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the space and time separation of such videos makes it challenging to develop a successful VR streaming framework. Most proposed schemes including [20], [23], [60], [61] use different quality levels for the viewport and background tiles. This approach can assist in bandwidth-efficient streaming.…”

Section: B Tile-based Adaptive Streamingmentioning

confidence: 99%

A Combined Field-of-View Prediction-Assisted Viewport Adaptive Delivery Scheme for 360° Videos

Yaqoob

Muntean

2021

IEEE Trans. on Broadcast.

View full text Add to dashboard Cite

Recently, 360 • or omnidirectional videos have become increasingly popular for both personal and enterprize use-cases. However, 360 • video streaming has very high bandwidth and processing requirements. State-of-the-art viewport-based streaming solutions lower these requirements by performing selective streaming based on long-term Field-of-View (FoV) prediction mechanisms. However, sometimes user movement is extremely unpredictable during some parts of the video, and applying these solutions adversely affects the overall quality of experience (QoE). This paper proposes a novel Combined Field-of-View tile-based adaptive streaming solution (CFOV) that improves end-user QoE for 360 • video streaming. CFOV performs interactive tile selection based on more accurate dynamical viewing area identification by combining the results of two FoV prediction mechanisms. It also employs an innovative priority-based bitrate adaptation approach that ensures improved bitrate budget distribution between different tiles. We evaluate the proposed solution with a comprehensive set of experiments involving four immersive videos, diverse tiling patterns (i.e., 4x3, 6x4, and 8x6), different segment lengths (i.e., 1s, 2s, and 3s), and 48 empirical head movement traces under different bandwidth settings. The evaluation employs a newly defined QoE metric specifically introduced to assess the streaming performance of 360 • videos objectively. The experimental findings show that, compared to alternative approaches, our proposed solution can achieve a higher viewport match and can significantly improve the user QoE for different watching behaviors and content characteristics.

show abstract

Section: B Tile-based Adaptive Streamingmentioning

confidence: 99%

A Combined Field-of-View Prediction-Assisted Viewport Adaptive Delivery Scheme for 360° Videos

Yaqoob

Muntean

2021

IEEE Trans. on Broadcast.

View full text Add to dashboard Cite

show abstract

“…The base layer provided the entire 360-degree video frame, while the enhancement layer improved the quality of the tiles corresponding to the predicted field of view (FoV). A study by [22] determined an optimal bit allocation technique for each tile based on the user viewport, and [24] used quantization parameters for bit allocation across the tiles. [23] proposed an optimal hypertext transfer protocol (HTTP) streaming for the encoded tiles, and OpTile [4] adaptively determined the size of the tiles to reduce the storage requirement of HTTP streaming.…”

Section: B Viewport-adaptive 360-degree Video Streamingmentioning

confidence: 99%

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

Fujihashi

Saruwatari

et al. 2021

IEEE Access

View full text Add to dashboard Cite

The existing viewport-adaptive 360-degree video streaming schemes encode tiled 360degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realize high-quality wireless 360-degree video streaming, we propose a novel viewport-adaptive soft delivery scheme for 360-degree videos, called 360Cast+. 360Cast+ skips the non-linear operations in digital-based streaming and adopts power allocation and analog modulation to achieve graceful video quality improvement in unstable wireless links. In particular, 360Cast+ integrates the human vision system (HVS) and projection distortion as a perceptual weight in power allocation operations. A near-optimal low-complexity subcarrier matching algorithm was also adopted to extend 360Cast+ to fading channel environments. To reduce the effect of the prediction error, 360Cast+ uses dynamic linear regression (DLR) to predict the future orientation and future prediction error to extract the extension area around a viewport. The evaluation results demonstrated that the proposed 360Cast+ provides sophisticated video quality irrespective of the prediction error and channel conditions in orthogonal frequency-division multiplexing (OFDM)-based systems. INDEX TERMS 360-degree video delivery, soft delivery, viewport adaptive

show abstract

“…A tile based streaming system based on DASH and HEVC was presented in [37]. The system uses CMP to represent the 360°video.…”

Section: Latency Effect On Tile-based Streamingmentioning

confidence: 99%

“…Although no subjective evaluation has been performed assessing the effect of showing low-resolution content or mixed-resolution content for a short period of time, implementations of such solutions have been showcased, as e.g. [37], and it seems to be acceptable for the viewer to show such a lower fidelity content for a couple of hundreds of milliseconds.…”

Section: Latency Effect On Tile-based Streamingmentioning

confidence: 99%

Delay Impact on MPEG OMAF’s Tile-Based Viewport-Dependent 360° Video Streaming

Fuente

Bhullar

Skupin

et al. 2019

IEEE J. Emerg. Sel. Topics Circuits Syst.

Self Cite

View full text Add to dashboard Cite

With the continuously increasing attention that 360°video streaming is drawing, several solutions have been developed lately. They can be grouped into two main categories, with the first one being the viewport-independent category that consists of encoding the whole 360°video content using a particular projection, e.g., Equirectangular Projection or Cubemap Projection, without taking any viewport orientation into account. Such approaches waste resources since content not being watched by the user is encoded with the same visual fidelity as the content actually watched. The second category, the viewport-dependent category, relies on techniques that allow for viewport adaptivity. One approach is to apply viewport-dependent projections, wherein the spherical 360°video is mapped onto a rectangular frame in such a way that a specific viewport is mapped to a comparatively larger part of the rectangular frame than the rest of the content. Another approach, as specified in MPEG OMAF, is to use tile-based streaming, with the 360°video being offered in a tiled manner at various resolutions. Thus, each user can retrieve the tiles at different resolutions so that the high-resolution tiles match its viewport. Although viewport-dependent approaches allow providing better visual quality at the viewport, the end-toend delay is critical, since it has an impact on the time needed by clients to adapt to user movements so that movements are reflected on the retrieved content. In this paper, we analyze the impact of the delay and introduce various means to reduce the impact on the observed fidelity.

show abstract

HEVC tile based streaming to head mounted displays

Cited by 27 publications

References 3 publications

A Combined Field-of-View Prediction-Assisted Viewport Adaptive Delivery Scheme for 360° Videos

A Combined Field-of-View Prediction-Assisted Viewport Adaptive Delivery Scheme for 360° Videos

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

Delay Impact on MPEG OMAF’s Tile-Based Viewport-Dependent 360° Video Streaming

Contact Info

Product

Resources

About