Adaptive 360-degree video streaming using layered video coding

TaghaviNasrabadi, Afshin; Mahzari, Anahita; Beshay, Joseph D.; Prakash, Ravi

doi:10.1109/vr.2017.7892319

Cited by 71 publications

(29 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Especially, the authors verify that there is a distortion of spherical surface owing to assigning more pixels for the focused view. Nsrabadi et al [13] adopt layered encoding for VR streaming services. Here, base layer is allocated to all view points while enhancement layers are allocated only to the focused view points.…”

Section: Related Workmentioning

confidence: 99%

“…By considering the situation that only part of the entire view is displayed whereas the remaining parts are decoded but not displayed in VR streaming, there have been various approaches to design bandwidth-efficient VR streaming [2], [9][10][11][12][13][14]. However, even though some recent studies related to VR streaming services have been carried out, most of work focuses on video on-demand based VR streaming instead of live streaming.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Bandwidth-Efficient Live Virtual Reality Streaming Scheme for Reducing View Adaptation Delay

2019

KSII TIIS

View full text Add to dashboard Cite

This paper proposes a dynamic-tiling-based bandwidth-efficient (DTBE) virtual reality (VR) streaming scheme. We consider 360-degree VR contents with multiple view points such as the front, back, upper, and bottom sides. At a given time, the focus of a client is always bound to a certain view among multiple view points. By utilizing this perspective, under our proposed scheme, tiles with high encoding rates are selectively assigned to the focused view where multiple view points consist of multiple tiles with different encoding rates. The other tiles with low encoding rates are assigned to the remaining view points. Furthermore, for reducing view adaptation delay, we design a novel rapid view adaptation mechanism that selectively delivers an I-frame during view point updates by using frame indexing. We implement the proposed scheme on a commercial VR test bed where we adopt the MPEG media transport (MMT) standard with high-efficiency video coding (HEVC) tile modes. The measurement-based experiments show that the proposed scheme achieves an average data usage reduction of almost 65.2% as well as average view adaptation delay reduction of almost 57.7%.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Bandwidth-Efficient Live Virtual Reality Streaming Scheme for Reducing View Adaptation Delay

2019

KSII TIIS

View full text Add to dashboard Cite

show abstract

“…Moreover, results are only presented in a simulated environment. TaghaviNasrabadi et al use scalable video coding and tiling to stream the VR video [15]. The video is divided in di erent tiles, and each tile is encoded at di erent scalable layers.…”

Section: Related Work 21 360°video Streamingmentioning

confidence: 99%

An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos

Petrangeli

Swaminathan

Hosseini

et al. 2017

Proceedings of the 25th ACM International Conference on Multimedia

140

View full text Add to dashboard Cite

Virtual Reality (VR) devices are becoming accessible to a large public, which is going to increase the demand for 360°VR videos. VR videos are often characterized by a poor quality of experience, due to the high bandwidth required to stream the 360°video. To overcome this issue, we spatially divide the VR video into tiles, so that each temporal segment is composed of several spatial tiles. Only the tiles belonging to the viewport, the region of the video watched by the user, are streamed at the highest quality. The other tiles are instead streamed at a lower quality. We also propose an algorithm to predict the future viewport position and minimize quality transitions during viewport changes. The video is delivered using the server push feature of the HTTP/2 protocol. Instead of retrieving each tile individually, the client issues a single push request to the server, so that all the required tiles are automatically pushed back to back. This approach allows to increase the achieved throughput, especially in mobile, high RTT networks. In this paper, we detail the proposed framework and present a prototype developed to test its performance using real-world 4G bandwidth traces. Particularly, our approach can save bandwidth up to 35% without severely impacting the quality viewed by the user, when compared to a traditional non-tiled VR streaming solution. Moreover, in high RTT conditions, our HTTP/2 approach can reach 3 times the throughput of tiled streaming over HTTP/1.1, and consistently reduce freeze time. These results represent a major improvement for the e cient delivery of 360°VR videos over the Internet.

show abstract

“…Moreover, the study presented in [10] reveals high correlations between Peak Signal to Noise Ratio (PSNR) and perceptual quality. Nasrabadi et al [13] propose a layered encoding scheme for 360 • video delivery that reduces the probability of video freezes and the response latency to head movements. To reduce the bandwidth utilization, some proposals adopt 360 • video adaptation [14] or motion-based predictive solutions [15], [16].…”

Section: Related Workmentioning

confidence: 99%

360° Mulsemedia Experience over Next Generation Wireless Networks - A Reinforcement Learning Approach

Comsa

Trestian

Ghinea

2018

2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX)

View full text Add to dashboard Cite

The next generation of wireless networks targets aspiring key performance indicators, like very low latency, higher data rates and more capacity, paving the way for new generations of video streaming technologies, such as 360 • or omnidirectional videos. One possible application that could revolutionize the streaming technology is the 360 • MULtiple SEnsorial MEDIA (MULSEMEDIA) which enriches the 360 • video content with other media objects like olfactory, haptic or even thermoceptic ones. However, the adoption of the 360 • Mulsemedia applications might be hindered by the strict Quality of Service (QoS) requirements, like very large bandwidth and low latency for fast responsiveness to the user s inputs that could impact their Quality of Experience (QoE). To this extent, this paper introduces the new concept of 360 • Mulsemedia as well as it proposes the use of Reinforcement Learning to enable QoS provisioning over the next generation wireless networks that influences the QoE of the end-users.

show abstract

Adaptive 360-degree video streaming using layered video coding

Cited by 71 publications

References 4 publications

Bandwidth-Efficient Live Virtual Reality Streaming Scheme for Reducing View Adaptation Delay

Bandwidth-Efficient Live Virtual Reality Streaming Scheme for Reducing View Adaptation Delay

An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos

360° Mulsemedia Experience over Next Generation Wireless Networks - A Reinforcement Learning Approach

Contact Info

Product

Resources

About