Bandwidth-Efficient Live Virtual Reality Streaming Scheme for Reducing View Adaptation Delay

Abstract

This paper proposes a dynamic-tiling-based bandwidth-efficient (DTBE) virtual reality (VR) streaming scheme. We consider 360-degree VR contents with multiple view points such as the front, back, upper, and bottom sides. At a given time, the focus of a client is always bound to a certain view among multiple view points. By utilizing this perspective, under our proposed scheme, tiles with high encoding rates are selectively assigned to the focused view where multiple view points consist of multiple tiles with different encoding rates. The other tiles with low encoding rates are assigned to the remaining view points. Furthermore, for reducing view adaptation delay, we design a novel rapid view adaptation mechanism that selectively delivers an I-frame during view point updates by using frame indexing. We implement the proposed scheme on a commercial VR test bed where we adopt the MPEG media transport (MMT) standard with high-efficiency video coding (HEVC) tile modes. The measurement-based experiments show that the proposed scheme achieves an average data usage reduction of almost 65.2% as well as average view adaptation delay reduction of almost 57.7%.

A Cloud Exhibition Hall System of Extended Reality Using Apriori Algorithm

“…There are many pain points in traditional display: for example, large equipment cannot be transported for display due to the limitation of display space and cost, and it is difficult to convey the use scenario and experience of products to customers [1] ; Offline exhibition booths are limited, so more products cannot be displayed, and high-end products are not convenient to enter the site; For the raw materials, functions, structures and specifications of products, there is a lack of real application cases to show the products; The cost of field investigation is high, and it is impossible to deeply investigate the process, production line and capacity, which cannot be trusted by customers; In terms of exhibition content, due to the single means of exhibition and presentation, and the unified classification and division of parts, it is impossible to cross present, which easily leads to the fragmentation of the exhibition content, which makes the audience unable to form a deep memory when visiting the exhibition hall, which is not conducive to the audience's appreciation and experience; In terms of exhibition form, static display mode can hardly arouse the interest and curiosity of the audience, and can not let the audience interact with the exhibits, which makes people feel distant from the exhibition hall, and it is difficult to have emotional resonance with the exhibition hall, and also can not seriously watch the exhibition; In terms of visitors' experience, the traditional exhibition is a one-way indoctrination of information, which leads to a weak sense of experience of the audience, so that they have no good impression on the exhibition hall. At this stage, 5G technology and XR technology have become mature, and supporting the development of traditional industries in the direction of networking, digitalization and intelligence has become the current need.…”