Point Cloud Subjective Evaluation Methodology based on 2D Rendering

Alexiou, Evangelos; Ebrahimi, Touradj; Bernardo, Marco V.; Pereira, Manuela; Pinheiro, António; Cruz, Luís A. da Silva; Duarte, Carlos Rafael; Dmitrović, Lovorka Gotal; Dumic, Emil; Matkovics, Dragan; Skodras, Athanassios

doi:10.1109/qomex.2018.8463406

Cited by 53 publications

(52 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [16] subjective evaluation experiments were conducted in five different test laboratories to assess the visual quality of colorless point clouds, enabling the screened Poisson surface reconstruction algorithm [51] as a rendering methodology. The contents were degraded using octree-pruning, and the observers visualized the mesh models in a passive way.…”

Section: A) Subjective Quality Assessmentmentioning

confidence: 99%

A comprehensive study of the rate-distortion performance in MPEG point cloud compression

Alexiou

Viola

Borges

et al. 2019

SIP

Self Cite

108

View full text Add to dashboard Cite

Recent trends in multimedia technologies indicate the need for richer imaging modalities to increase user engagement with the content. Among other alternatives, point clouds denote a viable solution that offers an immersive content representation, as witnessed by current activities in JPEG and MPEG standardization committees. As a result of such efforts, MPEG is at the final stages of drafting an emerging standard for point cloud compression, which we consider as the state-of-the-art. In this study, the entire set of encoders that have been developed in the MPEG committee are assessed through an extensive and rigorous analysis of quality. We initially focus on the assessment of encoding configurations that have been defined by experts in MPEG for their core experiments. Then, two additional experiments are designed and carried to address some of the identified limitations of current approach. As part of the study, state-of-the-art objective quality metrics are benchmarked to assess their capability to predict visual quality of point clouds under a wide range of radically different compression artifacts. To carry the subjective evaluation experiments, a web-based renderer is developed and described. The subjective and objective quality scores along with the rendering software are made publicly available, to facilitate and promote research on the field.

show abstract

Section: A) Subjective Quality Assessmentmentioning

confidence: 99%

A comprehensive study of the rate-distortion performance in MPEG point cloud compression

Alexiou

Viola

Borges

et al. 2019

SIP

Self Cite

108

View full text Add to dashboard Cite

show abstract

“…More details about the point cloud dataset can be found in. 5 The original raw point clouds were initially scaled to fit in a bounding box of size 1 and translated at the origin (0, 0, 0). Then, the distorted versions were produced following the aforementioned procedure.…”

Section: Content Preparationmentioning

confidence: 99%

“…The subjective scores collected in this experiment were compared to ratings obtained from a previous experiment, which is described in. 5 Specifically, the same set of test contents was assessed using typical 2D displays in five test laboratories. The size of the displays used varied from 28" to 50", and the resolution from FHD to 4K.…”

Section: Comparison Between Subjective Scores For Mesh Visualization mentioning

confidence: 99%

“…Based on the performance indexes, the correlation between these two tests is poor, which is in agreement with the results of our previous work. 5 The outcome of this analysis is that using a surface reconstruction technique as a pre-rendering step to consume 3D objects leads to differently rated visible distortions in both 2D and 3D display setups, with respect to visualization of raw point cloud contents.…”

Section: Comparison Between Subjective Scores After Pc and Mesh Visuamentioning

confidence: 99%

“…Three different 3D monitors were used according to each testing laboratory availability. The dataset proposed in a previous work 5 was employed to facilitate a comparison between previous work, on our aim to identify statistical differences that may occur by different point cloud rendering and representation approaches.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Point cloud subjective evaluation methodology based on reconstructed surfaces

Alexiou

Pinheiro

Duarte

et al. 2018

Applications of Digital Image Processing XLI

Self Cite

View full text Add to dashboard Cite

Point clouds have been gaining importance as a solution to the problem of efficient representation of 3D geometric and visual information. They are commonly represented by large amounts of data, and compression schemes are important for their manipulation transmission and storing. However, the selection of appropriate compression schemes requires effective quality evaluation. In this work a subjective quality evaluation of point clouds using a surface representation is analyzed. Using a set of point cloud data objects encoded with the popular octree pruning method with different qualities, a subjective evaluation was designed. The point cloud geometry was presented to observers in the form of a movie showing the 3D Poisson reconstructed surface without textural information with the point of view changing in time. Subjective evaluations were performed in three different laboratories. Scores obtained from each test were correlated and no statistical differences were observed. Scores were also correlated with previous subjective tests and a good correlation was obtained when compared with mesh rendering in 2D monitors. Moreover, the results were correlated with state of the art point cloud objective metrics revealing poor correlation. Likewise, the correlation with a subjective test using a different representation of the point cloud data also showed poor correlation. These results suggest the need for more reliable objective quality metrics and further studies on adequate point cloud data representations.

show abstract