Point Cloud Streaming for 3D Avatar Communication

Kajitani, Masaharu; Takahashi, Shinichiro; Okuda, Masahiro

doi:10.5772/5902

Cited by 1 publication

(1 citation statement)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A special firmware fixing the multipath interference problem during the use of multiple Microsoft Kinect v2 has been developed and reported by Microsoft [7], but has never been released to the public. 3D data acquisition system using one or more RGB-D cameras (depth sensing device that work in association with RGB color camera) have previously been reported [8,9,10,11]. A more complete and recent review on 3D Reconstruction with RGB-D cameras has also been reported [12], and provides a complete state of the art of the multiple possible approaches, with technical details of existing systems.…”

Section: State Of the Artmentioning

confidence: 99%

Real-time 360 Body Scanning System for Virtual Reality Research Applications

Albert¹,

Lance²,

Dubessy³

et al. 2019

Proceedings of 3DBODY.TECH 2019 - 10th International Conference and Exhibition on 3D Body Scanning and Processing Technologies,

View full text Add to dashboard Cite

Here, we present a low-cost solution to perform the online and realistic representation of users using an array of depth cameras. The system is composed of a cluster of 10 Microsoft Kinect 2 cameras, each one associated to a compact NUC PC to stream live depth & color images to a master PC which reconstructs live the point cloud of the scene and can in particular show the body of users standing in the capture area. A custom geometric calibration procedure allows accurate reconstruction of the different 3D data streams. Despite the inherent limitations of depth cameras, in particular sensor noise, the system provides a convincing representation of the user's body, is not limited by changes in clothing (also during immersion), can capture complex poses and even interactions between two persons or with physical objects. The advantage of using depth cameras over conventional cameras is that little processing is required for dynamic reconstruction of unknown shapes, thus allowing true interactive applications. The resulting live 3D model can be inserted in any virtual environment (e.g. Unity 3D software integration plugin), and can be subject to all usual 3D manipulation and transformations.

show abstract