Benchmarking Open-Source Static 3D Mesh Codecs for Immersive Media Interactive Live Streaming

Abstract

This work provides a systematic understanding of the requirements of live 3D mesh coding, targeting (tele-)immersive media streaming applications. We thoroughly benchmark in rate-distortion and runtime performance terms, four static 3D mesh coding solutions that are openly available. Apart from mesh geometry and connectivity, our analysis includes experiments for compressing vertex normals and attributes, something scarcely found in literature. Additionally, we provide a theoretical model of the tele-immersion pipeline that calculates its expected frame-rate, as well as lower and upper bounds for its end-to-end latency. In order to obtain these measures, the theoretical model takes into account the compression performance of the codecs and some indicative network conditions. Based on the results we obtained through our codec benchmarking, we used our theoretical model to calculate and provide concrete measures for these tele-immersion pipeline's metrics and discuss on the optimal codec choice depending on the network setup. This offers deep insight into the available solutions and paves the way for future research.

Textured Mesh vs Coloured Point Cloud: A Subjective Study for Volumetric Video Compression

“…Nevertheless, only some of these studies considered the stateof-the-art compression methods in a way which can be beneficial for a VV setting. Doumanoglou et al [22] and Christaki et al [23] studied different open source mesh compression algorithms and found Google's Draco the best performing among the compared. Su et al [12] used static point clouds to compare three different encoders: L-PCC, S-PCC, and V-PCC.…”

Mesh compression method with on-the-fly decompression during rasterization and streaming support

“…Mesh streaming (loading of only necessary mesh data instead of loading the whole mesh) can also be used, but most existing solutions propose only mesh transfer over the network [Kim04]. Partial load of mesh data from external storage to RAM for more effective processing (including compression) is also described [Ise05], but in all cases only the decompressed mesh is used during rendering [Dou19].…”

3D Geometry-Based Global Motion Compensation For VVC

“…So far, many mesh compression algorithms have been proposed, e.g., Corto [24], Google Draco [25], O3dgc [26], and OpenCTM [27]. We decided to use Google Draco, an open-source library developed by Google, because it is one of the most efficient and fastest algorithms according to recent benchmarking studies [28] and also our experiments. In the following, Draco's core blocks are described.…”