HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications

Zare, Alireza; Aminlou, Alireza; Hannuksela, Miska M.; Gabbouj, Moncef

doi:10.1145/2964284.2967292

Cited by 198 publications

(86 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Different tile partitions result in different panoramic experience. Existing studies have presented efficient methods of how to cut a 360-degree video into suitable sized tiles [21]- [24]. By investigating the tradeoff between bitrate overhead, view switching adaptivity, and the bandwidth consumption, the partition method with 4 rows and 6 columns is the recommended [20].…”

Section: A Tile-based 360-degree Videomentioning

confidence: 99%

Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos

Yuan

Zhao

Hou

et al. 2020

IEEE J. Sel. Top. Signal Process.

View full text Add to dashboard Cite

The 360-degree video allows users to enjoy the whole scene by interactively switching viewports. However, the huge data volume of the 360-degree video limits its remote applications via network. To provide high quality of experience (QoE) for remote web users, this paper presents a tile-based adaptive streaming method for 360-degree videos. First, we propose a simple yet effective rate adaptation algorithm to determine the requested bitrate for downloading the current video segment by considering the balance between the buffer length and video quality. Then, we propose to use a Gaussian model to predict the field of view at the beginning of each requested video segment. To deal with the circumstance that the view angle is switched during the display of a video segment, we propose to download all the tiles in the 360-degree video with different priorities based on a Zipf model. Finally, in order to allocate bitrates for all the tiles, a two-stage optimization algorithm is proposed to preserve the quality of tiles in FoV and guarantee the spatial and temporal smoothness. Experimental results demonstrate the effectiveness and advantage of the proposed method compared with the state-of-the-art methods. That is, our method preserves both the quality and the smoothness of tiles in FoV, thus providing the best QoE for users.Index Terms-360-degree video, field of view, rate adaptation, DASH, video compression, quality of experience.

show abstract

Section: A Tile-based 360-degree Videomentioning

confidence: 99%

Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos

Yuan

Zhao

Hou

et al. 2020

IEEE J. Sel. Top. Signal Process.

View full text Add to dashboard Cite

show abstract

“…360°video streaming has attracted tremendous attention in industry [3,7,55] and academia [25,32,33,35,36,41,52,[59][60][61][62]66]. Here we survey the work most closely related to Pano.…”

Section: Related Workmentioning

confidence: 99%

Pano

Guan

Zheng

Zhang

et al. 2019

Proceedings of the ACM Special Interest Group on Data Communication

116

View full text Add to dashboard Cite

Streaming 360°videos requires more bandwidth than non-360°v ideos. This is because current solutions assume that users perceive the quality of 360°videos in the same way they perceive the quality of non-360°videos. This means the bandwidth demand must be proportional to the size of the user's field of view. However, we found several quality-determining factors unique to 360°videos, which can help reduce the bandwidth demand. They include the moving speed of a user's viewpoint (center of the user's field of view), the recent change of video luminance, and the difference in depth-of-fields of visual objects around the viewpoint.This paper presents Pano, a 360°video streaming system that leverages the 360°video-specific factors. We make three contributions. (1) We build a new quality model for 360°videos that captures the impact of the 360°video-specific factors. (2) Pano proposes a variable-sized tiling scheme in order to strike a balance between the perceived quality and video encoding efficiency. (3) Pano proposes a new quality-adaptation logic that maximizes 360°video user-perceived quality and is readily deployable. Our evaluation (based on user study and trace analysis) shows that compared with state-of-the-art techniques, Pano can save 41-46% bandwidth without any drop in the perceived quality, or it can raise the perceived quality (user rating) by 25%-142% without using more bandwidth.

show abstract

“…Outatime [42] speculates user behaviors to improve the interactivity of mobile cloud games. Zare et al [67] and Haynes et al [35] propose to predict user head movement to improve network bandwidth-efficiency in VR video streaming. Corm [48] speculative executes JavaScript event callbacks in order to improve the webpage loading performance.…”

Section: Related Workmentioning

confidence: 99%

Pes

Zhu

2019

Proceedings of the 46th International Symposium on Computer Architecture

View full text Add to dashboard Cite

Web applications are gradually shifting toward resource-constrained mobile devices. As a result, the Web runtime system must simultaneously address two challenges: responsiveness and energy-efficiency. Conventional Web runtime systems fall short due to their reactive nature: they react to a user event only after it is triggered. The reactive strategy leads to local optimizations that schedule event executions one at a time, missing global optimization opportunities.This paper proposes Proactive Event Scheduling (PES). The key idea of PES is to proactively anticipate future events and thereby globally coordinate scheduling decisions across events. Specifically, PES predicts events that are likely to happen in the near future using a combination of statistical inference and application code analysis. PES then speculatively executes future events ahead of time in a way that satisfies the QoS constraints of all the events while minimizing the global energy consumption. Fundamentally, PES unlocks more optimization opportunities by enlarging the scheduling window, which enables coordination across both outstanding events and predicted events. Hardware measurements show that PES reduces the QoS violation and energy consumption by 61.2% and 26.5%, respectively, over the Android's default Interactive CPU governor. It also reduces the QoS violation and energy consumption by 63.1% and 17.9%, respectively, compared to EBS, a state-of-the-art reactive scheduler.

show abstract

HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications

Cited by 198 publications

References 2 publications

Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos

Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos

Pano

Pes

Contact Info

Product

Resources

About