Dynamic Adaptive Point Cloud Streaming

Abstract

High-quality point clouds have recently gained interest as an emerging form of representing immersive 3D graphics. Unfortunately, these 3D media are bulky and severely bandwidth intensive, which makes it difficult for streaming to resourcelimited and mobile devices. This has called researchers to propose efficient and adaptive approaches for streaming of high-quality point clouds.In this paper, we run a pilot study towards dynamic adaptive point cloud streaming, and extend the concept of dynamic adaptive streaming over HTTP (DASH) towards DASH-PC, a dynamic adaptive bandwidth-efficient and view-aware point cloud streaming system. DASH-PC can tackle the huge bandwidth demands of dense point cloud streaming while at the same time can semantically link to human visual acuity to maintain high visual quality when needed. In order to describe the various quality representations, we propose multiple thinning approaches to spatially sub-sample point clouds in the 3D space, and design a DASH Media Presentation Description manifest specific for point cloud streaming. Our initial evaluations show that we can achieve significant bandwidth and performance improvement on dense point cloud streaming with minor negative quality impacts compared to the baseline scenario when no adaptations is applied. CCS CONCEPTS•Information systems →Multimedia streaming; ACM Reference format:

Objective and Subjective QoE Evaluation for Adaptive Point Cloud Streaming

“…Hosseini and Timmerer are the first to propose a standardscompliant approach for on-demand PCS of a single object [1]. The authors sample different points to generate versions of lower quality, and request objects on a per-frame basis.…”

“…We implemented the setup and algorithms proposed by van der Hooft et al [2] and deployed them on a dedicated network testbed 1 . This allowed us to replicate their experiments and analyze the observed results ourselves.…”

“…A segment duration of one second (corresponding to 30 frames) is considered in this work. 1 https://doc.ilabt.imec.be/ilabt/virtualwall/ Second, the point cloud objects were merged together to form different scenes. We considered two different types of scenes: one in which the objects (humans) are positioned in a line, and one in which they are placed on a semi-circle.…”

“…Even though various approaches have already proposed to apply HAS to point clouds, this is still a niche area of research. Notable studies include the ones by Hosseini and Timmerer [1] and van der Hooft et al [2]. While these studies agree on the advantages of using HAS to nicely trade off the streaming quality with the bandwidth consumption, the impact of this trade-off on the user perception, i.e., on the quality of experience (QoE), is yet to be thoroughly examined.…”

Pc-Mcu

“…Other peer-to-peer oriented strategies, for the dynamic streaming of Point Clouds, have been proposed by Hosseini and Timmerer [6], including a resolution scalability strategy, giving the chance to select the best trade-off between quality and bandwidth/resolution. Qian et al [15] proposed a volumetric video streaming system for commodity mobile phones, where they propose heuristics to decide on representations and to use edge computing to reduce the computational load on mobile clients.…”