Tiling of panorama video for interactive virtual cameras: Overheads and potential bandwidth requirement reduction

Gaddam, Vamsidhar Reddy; Ngo, Hoang Bao; Langseth, Ragnar; Griwodz, Carsten; Johansen, Dag; Halvorsen, Pål

doi:10.1109/pcs.2015.7170076

Cited by 10 publications

(4 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Thus, the most common approach is to request the tiles on the client side. First, there are several approaches that evaluate strategies for tile download for partial panoramas [12,13,22,21,15,20]. There are also many recent approaches that work exclusively on 360 • systems [1,2,7,14,28,40,41].…”

Section: Related Workmentioning

confidence: 99%

“…This means that each user interactively controls a "virtual camera" to create their view when moving their FoV, resulting in different streams for every user. In the area of on-demand over-the-top streaming type of applications, there are many solutions that use DASH (Dynamic Adaptive Streaming over HTTP) or similar solutions [12,14,25,1,40], aiming for optimized tile selection, rate adaptation and storage optimizations, etc. These have the potential to save a lot of bandwidth, but encoding the video in tiles comes with a streaming and storage penalty as more headers are required, the coding efficiency is reduced and more download requests must be sent.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Griwodz

Jeppsson

Espeland

et al. 2019

Int. J. Semantic Computing

Self Cite

View full text Add to dashboard Cite

360∘ panorama video displayed through Virtual Reality (VR) glasses or large screens offers immersive user experiences, but as such technology becomes commonplace, the need for efficient streaming methods of such high-bitrate videos arises. In this respect, the attention that 360∘ panorama video has received lately is huge. Many methods have already been proposed, and in this paper, we shed more light on the different trade-offs in order to save bandwidth while preserving the video quality in the user’s field-of-view (FoV). Using 360∘ VR content delivered to a Gear VR head-mounted display with a Samsung Galaxy S7 and to a Huawei Q22 set-top-box, we have tested various tiling schemes analyzing the tile layout, the tiling and encoding overheads, mechanisms for faster quality switching beyond the DASH segment boundaries and quality selection configurations. In this paper, we present an efficient end-to-end design and real-world implementation of such a 360∘ streaming system. Furthermore, in addition to researching an on-demand system, we also go beyond the existing on-demand solutions and present a live streaming system which strikes a trade-off between bandwidth usage and the video quality in the user’s FoV. We have created an architecture that combines RTP and DASH, and our system multiplexes a single HEVC hardware decoder to provide faster quality switching than at the traditional GOP boundaries. We demonstrate the performance and illustrate the trade-offs through real-world experiments where we can report comparable bandwidth savings to existing on-demand approaches, but with faster quality switches when the FoV changes.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Griwodz

Jeppsson

Espeland

et al. 2019

Int. J. Semantic Computing

Self Cite

View full text Add to dashboard Cite

show abstract

“…Based on the user interactivity, if the desired RoI is not available at the desired resolution, a lower resolution might be still obtained and is upscaled to the proper resolution for display. In [17], authors show the impact of using tiles in an interactive system that allows for panning and zooming in terms of overhead.…”

Section: Related Workmentioning

confidence: 99%

Video processing for panoramic streaming using HEVC and its scalable extensions

Fuente

Skupin

Schierl

2016

Multimed Tools Appl

View full text Add to dashboard Cite

Panoramic streaming is a particular way of video streaming where an arbitrary Region-of-Interest (RoI) is transmitted from a high-spatial resolution video, i.e. a video covering a very Bwide-angle^(much larger than the human field-of-view -e.g. 360°). Some transport schemes for panoramic video delivery have been proposed and demonstrated within the past decade, which allow users to navigate interactively within the high-resolution videos. With the recent advances of head mounted displays, consumers may soon have immersive and sufficiently convenient end devices at reach, which could lead to an increasing demand for panoramic video experiences. The solution proposed within this paper is built upon tile-based panoramic streaming, where users receive a set of tiles that match their RoI, and consists in a low-complexity compressed domain video processing technique for using H.265/HEVC and its scalable extensions (H.265/SHVC and H.265/MV-HEVC). The proposed technique generates a single video bitstream out of the selected tiles so that a single hardware decoder can be used. It overcomes the scalability issue of previous solutions not using tiles and the battery consumption issue inherent of tile-based panorama streaming, where multiple parallel software decoders are used. In addition, the described technique is capable of reducing peak streaming bitrate during changes of the RoI, which is crucial for allowing a truly immersive and low latency video experience. Besides, it makes it possible to use Open GOP structures without incurring any playback interruption at switching events, which provides a better compression efficiency compared to closed GOP structures.

show abstract

“…The first approach to provide users with more interactive video, the tile-based method, has already been thoroughly discussed in the literature [3,5,6,9,10,12]. This technique was mostly applied to the H.264/AVC codec.…”

Section: State-of-the-artmentioning

confidence: 99%

Efficient Encoding of Interactive Personalized Views Extracted from Immersive Video Content

Praeter

Duchi

Wallendael

et al. 2016

Proceedings of the 1st International Workshop on Multimedia Alternate Realities

View full text Add to dashboard Cite

Traditional television limits people to a single viewpoint. However, with new technologies such as virtual reality glasses, the way in which people experience video will change. Instead of being limited to a single viewpoint, people will demand a more immersive experience that gives them a sense of being present in a sports stadium, a concert hall, or at other events. To satisfy these users, video such as 360-degree or panoramic video needs to be transported to their homes. Since these videos have an extremely high resolution, sending the entire video requires a high bandwidth capacity and also results in a high decoding complexity at the viewer. The traditional approach to this problem is to split the original video into tiles and only send the required tiles to the viewer. However, this approach still has a large bit rate overhead compared to sending only the required view. Therefore, we propose to send only a personalized view to each user. Since this paper focuses on reducing the computational cost of such a system, we accelerate the encoding of each personalized view based on coding information obtained from a pre-analysis on the entire ultra-high-resolution video. By doing this using the High Efficiency Video Coding Test Model (HM), the complexity of each individual encode of a personalized view is reduced by more than 96.5% compared to a full encode of the view. This acceleration results in a bit rate overhead of at most 19.5%, which is smaller compared to the bit rate overhead of the tile-based method.

show abstract

Tiling of panorama video for interactive virtual cameras: Overheads and potential bandwidth requirement reduction

Cited by 10 publications

References 17 publications

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Video processing for panoramic streaming using HEVC and its scalable extensions

Efficient Encoding of Interactive Personalized Views Extracted from Immersive Video Content

Contact Info

Product

Resources

About