PanoWalk: A Remote Image-Based Rendering System for Mobile Devices

Jiang, Zhongding; Mao, Yandong; Jia, Qi; Jiang, Nan; Tao, Junyi; Fang, Xiaochun; Bao, Hujun

doi:10.1007/11922162_74

Cited by 2 publications

(4 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The proposed protocol not only alleviates the navigation limitation of previous works [Yang and Crawfis 2002;Jiang et al 2006;Seo et al 2013], but also minimizes the delay between viewpoint updates at the client end, allowing for a much richer and smoother interactive experience. Another motivation for this work is the use of remote rendering and IBR to assist emergency responders in their duties.…”

Section: Introductionmentioning

confidence: 85%

“…The proposed technique is able to cache future locations that a user might move into and to provide the user with more movement options than the existing solutions. In previous works [Yang and Crawfis 2002;Jiang et al 2006], user navigation is restricted to predefined paths, giving the streaming system more room for prediction and prefetching. In Google Street View [Anguelov et al 2010], the user "hops" from position to position on a predefined path.…”

Section: The Proposed Rendering and Streaming Techniquementioning

confidence: 99%

“…The drawback of this solution is limited interactive experience, since movement is restricted to certain locations. In PanoWalk [Jiang et al 2006], scene data is compressed by a customized mobile device MPEG encoder. The server determines the required data for a client and streams compressed PVs to the client, which performs rendering locally using image warping.…”

Section: Related Workmentioning

confidence: 99%

“…However, remote rendering is a bandwidth-intensive technique that requires a large volume of images, resulting in network jitter that may compromise the interactive experience or reduce the capacity of the system in terms of concurrent sessions. Most of the previous works consider limited navigation schemes as a means of decreasing the amount of streamed data, for instance, limiting user interaction by allowing only movements on predefined paths [Yang and Crawfis 2002], or even warping instantly from one view to another [Jiang et al 2006]. In addition, traditional video streaming techniques [Chi et al 2007;Luo et al 2009] cannot be directly applied to interactive 3D streaming due to the free user interaction with the 3D environment.…”

Section: Introductionmentioning

confidence: 98%

See 3 more Smart Citations

Propane

Pazzi

Boukerche

2014

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

Image-Based Rendering (IBR) has become widely known by its relatively low requirements for generating new scenes based on a sequence of reference images. This characteristic of IBR shows a remarkable potential impact in rendering complex 3D virtual environments on graphics-constrained devices, such as head-mounted displays, set-top boxes, media streaming devices, and so on. If well exploited, IBR coupled with remote rendering would enable the exploration of complex virtual environments on these devices. However, remote rendering requires the transmission of a large volume of images. In addition, existing solutions consider limited and/or deterministic navigation schemes as a means of decreasing the volume of streamed data. This article proposes the PROgressive PANorama StrEaming protocol (PROPANE) to offer users a smoother virtual navigation experience by prestreaming the imagery data required to generate new views as the user wanders within a 3D environment. PROPANE is based on a very simple yet effective trigonometry model and uses a strafe (lateral movement) technique to minimize the delay between image updates at the client end. This article introduces the concept of key partial panoramas, namely panorama segments that cover movements in any direction by simply strafing from an appropriate key partial panorama and streaming the amount of lost pixels. Therefore, PROPANE can provide a constrained device with sufficient imagery data to cover a future user's viewpoints, thereby minimizing the impact of transmission delay and jitter. PROPANE has been implemented and compared to two baseline remote rendering schemes. The evaluation results show that the proposed technique outperforms the selected and closely related existing schemes by minimizing the response time while not limiting the user to predefined paths as opposed to previous protocols.

show abstract

Section: Introductionmentioning

confidence: 85%

Section: The Proposed Rendering and Streaming Techniquementioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 98%

See 2 more Smart Citations