Fast 3D Mesh Compression Using Shared Vertex Analysis

Jang, Euee S.; Lee, Seoungwook; Koo, Bon-Ki; Kim, Daiyong; Son, Kyoungsoo

doi:10.4218/etrij.10.0209.0357

Cited by 7 publications

(7 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The work in [16], which we find particularly useful, categorizes different representations on a spectrum between image-based methods and geometry-based methods ( Figure 2). Examples of geometry-based representations include triangle meshes and point clouds.…”

Section: D Representationmentioning

confidence: 98%

A 3D tele-immersion system based on live captured mesh geometry

Mekuria

Sanna

Asioli

et al. 2013

Proceedings of the 4th ACM Multimedia Systems Conference

View full text Add to dashboard Cite

3D Tele-immersion enables participants in remote locations to share, in real-time, an activity. It offers users natural interactivity and immersive experiences, but it challenges current networking solutions. Work in the past has mainly focused on the efficient delivery of image-based 3D videos and on the realistic rendering and reconstruction of geometry-based 3D objects. The contribution of this paper is a complete media pipeline that allows for geometry-based 3D tele-immersion. Unlike previous approaches, that stream videos or video plus depth estimate, our streaming module can transmit the live-reconstructed 3D representations (triangle meshes). Based on a set of comparative experiments, this paper details the architecture and describes a novel component that can efficiently stream geometry in realtime. This component includes both a novel fast local compression algorithm and a rateless packet protection scheme geared towards the requirements imposed by real-time transmission of live-capture mesh geometry. Tests on a large dataset show an encoding and decoding speed-up of over 10 times at similar compression and quality rates, when compared to the high-end MPEG-4 SC3DMC mesh encoder. The implemented rateless code ensures complete packet loss protection of the triangle mesh object and avoids delay introduced by retransmissions. This approach is compared to a streaming mechanism over TCP and outperforms it at packet loss rates over 2% and/or latencies over 9 ms in terms of end-to-end transmission delay. As reported in this paper, the component has been successfully integrated into a larger tele-immersive environment that includes beyond state of the art 3D reconstruction and rendering modules. This resulted in a prototype that can capture, compress transmit and render triangle mesh geometry in real-time over the internet.

show abstract

Section: D Representationmentioning

confidence: 98%

A 3D tele-immersion system based on live captured mesh geometry

Mekuria

Sanna

Asioli

et al. 2013

Proceedings of the 4th ACM Multimedia Systems Conference

View full text Add to dashboard Cite

show abstract

“…Depending on usage scenario, either a highly efficient static mesh compression algorithm [1] can be used, or instead a low-complexity real-time algorithm [47] can be preferred. The rest of the proposed system is not affected by this choice.…”

Section: I-frame Codingmentioning

confidence: 99%

Toward Real-Time and Efficient Compression of Human Time-Varying Meshes

Doumanoglou

Alexiadis

Zarpalas

et al. 2014

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

In this paper, a novel skeleton-based approach to human time-varying mesh (H-TVM) compression is presented. The topic of TVM compression is new and has many challenges, such as handling the lack of obvious mapping of vertices across frames and handling the variable connectivity across frames, while maintaining efficiency, which are the most important ones. Very few works exist in the literature, while not all of the challenges have been addressed yet. In addition, developing an efficient and real-time solution, handling the above, obviously is a difficult task. We attempt to address the H-TVM compression problem inspired from video coding using different types of frames and trying to efficiently remove inter-frame geometric redundancy utilizing the recent advances in human skeleton tracking. The overall approach focuses on compression efficiency, low distortion, and low computation time enabling for realtime transmission of H-TVMs. It efficiently compresses geometry and vertex attributes of TVMs. In addition, this paper is the first to provide an efficient method for connectivity coding of TVMs, by introducing a modification to the state-of-the-art MPEG-4 TFAN algorithm. Experiments are conducted in the MPEG-3DGC TVM database. The method outperforms the stateof-the-art standardized static mesh coder MPEG-4 TFAN at low bit-rates, while remaining competent at high bit-rates. It gives a practical proof of concept that in the combined problem of geometry, connectivity, and vertex attribute coding of TVMs, efficient inter-frame redundancy removal is possible, establishing ground for further improvements. Finally, this paper proposes a method for motion-based coding of H-TVMs that can further enhance the overall experience when H-TVM compression is used in a tele-immersion scenario.

show abstract

“…The resulting prediction residuals are compressed via context adaptive arithmetic coding (CABAC) or other entropy coding schemes. Figure 4 An example of a common tfan configuration in a (manifold) mesh [6] Shared vertex Analysis, described in [7] is a slightly simpler and more direct approach to code the connectivity. It works by analyzing the face list of vertex indices, and tries to detect shared vertices between consecutive faces.…”

Section: Static Mesh Compressionmentioning

confidence: 99%

“…It has been important enough that specific ISO standards have been developed in the MPEG working group such as TFAN [6] and SVA [7] for static mesh objects and AFX FAMC [8] for animations representing meshes with a fixed connectivity and time varying geometry. These technologies are currently part of the MPEG-4 standard, and have been introduced fairly recently, superseding previous mesh codecs in MPEG-4, that did not address specific requirements such as fast decoding and an efficient handling of non-manifolds mesh models.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Source coding for transmission of reconstructed dynamic geometry: a rate-distortion-complexity analysis of different approaches

2014

View full text Add to dashboard Cite

Live 3D reconstruction of a human as a 3D mesh with commodity electronics is becoming a reality. Immersive applications (i.e. cloud gaming, tele-presence) benefit from effective transmission of such content over a bandwidth limited link. In this paper we outline different approaches for compressing live reconstructed mesh geometry based on distributing mesh reconstruction functions between sender and receiver. We evaluate rate-performance-complexity of different configurations. First, we investigate 3D mesh compression methods (i.e. dynamic/static) from MPEG-4. Second, we evaluate the option of using octree based point cloud compression and receiver side surface reconstruction.

show abstract

Fast 3D Mesh Compression Using Shared Vertex Analysis

Cited by 7 publications

References 6 publications

A 3D tele-immersion system based on live captured mesh geometry

A 3D tele-immersion system based on live captured mesh geometry

Toward Real-Time and Efficient Compression of Human Time-Varying Meshes

Source coding for transmission of reconstructed dynamic geometry: a rate-distortion-complexity analysis of different approaches

Contact Info

Product

Resources

About