Compression of IP images for antostereoseopic 3d imaging applications

2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video

2008

This material is published in the open archive of Mid Sweden University DIVA http://miun.diva-portal.org to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. EMPIRICAL RATE-DISTORTION ANALYSIS OF JPEG 2000 3D AND H.264/AVC CODED INTEGRAL IMAGING BASED 3D-IMAGES Roger OlssonDep. of Information Technology and Media, Mid Sweden University, Sundsvall, Sweden ABSTRACT Novel camera systems producing 3D-images containing light direction in addition to light intensity is emerging. Integral imaging (II) is a technique on which many of these systems rely. The pictures produced by these cameras (II-pictures) are space-requiring in terms of data storage compared to their 2D counterparts. This paper investigates how coding the II-pictures using H.264/AVC and JPEG 2000 Part 10 (JP3D) affect the images in terms of rate-distortion as well as introduced coding artifacts. A set of four reference images are coded using a number of pre-processing and encoding variants, so called coding schemes. For low bitrates (<0.5bpp) the H.264/AVC-based coding schemes have higher coding efficiency, which asymptotically level of at higher bitrates in favor of JP3D. The JP3D coded 3D-images show less spread in quality than H.264/AVC, when quality is evaluated using PSNR as a function of viewing angle. However, the distortion induced by H.264/AVC is primarily localized to object boarders within the 3D-image, which in initial tests appear less visible than the JP3D coding artifacts that spread out evenly over the image. Extensive subjective tests will be performed in future work to further support the presented results.

Section: Iii-b Evaluation Methodsmentioning

confidence: 99%

Empirical Rate-Distortion Analysis of JPEG 2000 3D and H. 264/AVC Coded Integral Imaging Based 3D-Images

2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video

2008

“…[3][4][5][6][7][8] This has the advantage of producing a result that in a single scalar value aggregates the quality of the complete data set of the 3D-image. Hence, it lends itself well to comparative studies where a single measurement using the metric also give rise to a single value.…”

Section: Previous Workmentioning

confidence: 99%

A novel quality metric for evaluating depth distribution of artifacts in coded 3D images

Stereoscopic Displays and Applications XIX

Sjöström

2008

The two-dimensional quality metric Peak-Signal-To-Noise-Ratio (PSNR) is often used to evaluate the quality of coding schemes for different types of light field based 3D-images, e.g. integral imaging or multi-view. The metric results in a single accumulated quality value for the whole 3D-image. Evaluating single views -seen from specific viewing anglesgives a quality matrix that present the 3D-image quality as a function of viewing angle. However, these two approaches do not capture all aspects of the induced distortion in a coded 3D-image. We have previously shown coding schemes of similar kind for which coding artifacts are distributed differently with respect to the 3D-image's depth. In this paper we propose a novel metric that captures the depth distribution of coding-induced distortion. Each element in the resulting quality vector corresponds to the quality at a specific depth. First we introduce the proposed full-reference metric and the operations on which it is based. Second, the experimental setup is presented. Finally, the metric is evaluated on a set of differently coded 3D-images and the results are compared, both with previously proposed quality metrics and with visual inspection.

“…3 The set of EIs has been combined into a sequence that was then coded using a combination of JPEG-like intra-coding and MPEG-like intercoding techniques. 4 A similar approach was later proposed, where II-frames with a low number of high resolution EI was coded using the MPEG-2 video coding standard. 5 However, in our previous work we have shown that forming a sequence from EIs is not feasible for all II-structures.…”

Section: Introductionmentioning

confidence: 99%

“…This formed pseudo video sequence (PVS) is then coded using the video coding standard H.264/MPEG-4 AVC. Combined, this results in a significantly improved compression efficiency, both when compared to the EI-based PVS-scheme 4,5 as well as JPEG 2000 coding of the full II-frame.…”

Section: Introductionmentioning

confidence: 99%

Evaluation of a combined pre-processing and H.264-compression scheme for 3D integral images

Sjöström²,

2007

SPIE Proceedings

To provide sufficient 3D-depth fidelity, integral imaging (II) requires an increase in spatial resolution of several orders of magnitude from today's 2D images. We have recently proposed a pre-processing and compression scheme for still II-frames based on forming a pseudo video sequence (PVS) from sub images (SI), which is later coded using the H.264/MPEG-4 AVC video coding standard. The scheme has shown good performance on a set of reference images. In this paper we first investigate and present how five different ways to select the SIs when forming the PVS affect the schemes compression efficiency. We also study how the II-frame structure relates to the performance of a PVS coding scheme. Finally we examine the nature of the coding artifacts which are specific to the evaluated PVS-schemes. We can conclude that for all except the most complex reference image, all evaluated SI selection orders significantly outperforms JPEG 2000 where compression ratios of up to 342:1, while still keeping PSNR > 30 dB, is achieved. We can also confirm that when selecting PVS-scheme, the scheme which results in a higher PVS-picture resolution should be preferred to maximize compression efficiency. Our study of the coded II-frames also indicates that the SI-based PVS, contrary to other PVS schemes, tends to distribute its coding artifacts more homogenously over all 3D-scene depths.