Bit allocation for multiview image compression using cubic synthesized view distortion model

Velisavljević, Vladan; Cheung, Gene; Chakareski, Jacob

doi:10.1109/icme.2011.6012199

Cited by 18 publications

(11 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Studies presented in [23]- [25] target the optimal rate allocation problem such that the synthesized view distortion is minimized. Moreover, in [26], a relationship between the texture and depth quantization parameters (QPs) is estimated to simplify rate allocation.…”

Section: B Codingmentioning

confidence: 99%

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Zarb

Debono

2016

IEEE Systems Journal

View full text Add to dashboard Cite

Recent advances in mobile device technology, cellular networks, and multimedia coding have paved the way for a wide range of innovative multimedia services that can be delivered to mobile users. An interesting application is free-viewpoint television (FTV), which allows the viewer to interactively select the scene viewing angle. Conveying this service over cellular networks is very challenging due to the large bandwidth requirements and limitations in computational power, memory, and battery resources on mobile terminals. Moreover, providing FTV over mobile systems necessitates new means for quality evaluation, which consider cellular network parameters. To address these challenges, we propose a scalable FTV broadcast architecture for long-term evolution cellular networks. To alleviate complex processing on mobile receivers, depth maps are estimated in the cloud and transmitted along the multiview video. Moreover, a novel depth image-based rendering technique is developed to improve quality while minimizing processing load on the mobile terminal, giving typical peak signal-to-noise ratio gains of 2 dB. Experimental results reveal that, for a satisfactory rendering quality, bit-rate savings of more than 70% are achieved compared with simulcast transmission. Furthermore, subjective tests indicate that this solution improves the perceived quality considerably. Finally, we study the impact of handovers induced in mobile systems on the quality of experience.Index Terms-Depth image-based rendering (DIBR), free-viewpoint television (FTV), long-term evolution (LTE), multiview video coding (MVC), multiview video plus depth (MVD), quality of experience (QoE), 3-D video.

show abstract

Section: B Codingmentioning

confidence: 99%

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Zarb

Debono

2016

IEEE Systems Journal

View full text Add to dashboard Cite

show abstract

“…In previous work, Cheung [4] and Velisavljevic [6] derive a VVSD model with respect to the distance between virtual view and reference view, where Cheung takes a rough synthesis model to represent synthesis procedure, and Velisavljevic refines the synthesis model but fails to provide specific proofs for some observed features such as linearity of situation probability. Fang and Cheung [7] propose a VVSD model based on Power Spectral Density (PSD) and spatial analysis.…”

Section: Motivationmentioning

confidence: 99%

Depth Error Induced Virtual View Synthesis Distortion Estimation for 3D Video Coding

Xiang

Cheung

2015

2015 Data Compression Conference

View full text Add to dashboard Cite

We propose an analytical model to estimate the depth-error-induced virtual view synthesis distortion (VVSD) in 3D video, taking into account the configuration of the cameras. Focusing on view synthesis under depth error, we carefully analyze the merging operations under different situations that affect pixel availability: overlapping region, disocclusion and boundary region, disparity error region, and infrequent region. The analysis leads to quadratic/biquadratic models and linear models that explicitly relate the distance between camera positions (reference/virtual view) to Distortion under Different Situations (DDS) and Probability under Different Situations (PDS), respectively. We also show that VVSD is the linear combination of DDS weighted by PDS. Our careful analysis results in state-of-theart estimation accuracy. Experimental results verify that the proposed model is capable to produce accurate estimates of VVSD based on the distance between reference/virtual views. Therefore, our model can effectively inform camera setup for capturing, in particular, the set-up of the cameras in situation where depth information will be compressed subsequently. Data Compression Conference

show abstract

“…An autoregressive model was proposed by Kim et al [8] to estimate the synthesis distortion at the block level and was shown to be effective for rate-distortion optimized mode selection. A distortion model as a function of the view location was also proposed by Velisavljevic et al [9] for bit allocation. Takahashi [10] proposed an optimized view interpolation scheme based on frequency domain analysis of depth map error.…”

Section: Previous Workmentioning

confidence: 99%

Novel distortion metric for depth coding of 3D video

Cheung

et al. 2013

2013 IEEE International Conference on Image Processing

View full text Add to dashboard Cite

In state-of-the-art HEVC-based 3D video codec, multiview video plus associated depth maps are used. In order to achieve better coding performance, instead of the conventional sum of squared errors (SSE), view synthesis optimization (VSO) is proposed and included in the anchor encoder software to calculate view synthesis distortion in rate-distortion optimization (RDO) of depth coding. The anchor VSO achieves high rate-distortion (RD) performance. However, it requires partial rendering and is quite complex and time-consuming. On the other hand, simple SSE metric is fast but RD performance is low. In this paper, we propose a new distortion metric to be used in RDO for depth coding. The complexity of the proposed method is slightly higher than SSE, while its RD performance remains competitive. With a good trade-off between complexity and performance, the proposed method can replace the conventional SSE metric in RDO for depth coding, and can be used as a low-complexity alternative to the anchor VSO. IEEE International Conference on Image Processing (ICIP)This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for any other purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories, Inc. All rights reserved. ABSTRACTIn state-of-the-art HEVC-based 3D video codec, multiview video plus associated depth maps are used. In order to achieve better coding performance, instead of the conventional sum of squared errors (SSE), view synthesis optimization (VSO) is proposed and included in the anchor encoder software to calculate view synthesis distortion in rate-distortion optimization (RDO) of depth coding. The anchor VSO achieves high rate-distortion (RD) performance. However, it requires partial rendering and is quite complex and time-consuming. On the other hand, simple SSE metric is fast but RD performance is low. In this paper, we propose a new distortion metric to be used in RDO for depth coding. The complexity of the proposed method is slightly higher than SSE, while its RD performance remains competitive. With a good trade-off between complexity and performance, the proposed method can replace the conventional SSE metric in RDO for depth coding, and can be used as a low-complexity alternative to the anchor VSO.

show abstract

Bit allocation for multiview image compression using cubic synthesized view distortion model

Cited by 18 publications

References 11 publications

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks

Depth Error Induced Virtual View Synthesis Distortion Estimation for 3D Video Coding

Novel distortion metric for depth coding of 3D video

Contact Info

Product

Resources

About