A distributed video coding system for multi view video plus depth

Petrazzuoli, Giovanni; Maugey, Thomas; Cagnazzo, Marco; Pesquet‐Popescu, Béatrice

doi:10.1109/acssc.2013.6810373

Cited by 2 publications

(3 citation statements)

References 20 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We then derive a new rate-distortion model that links this dissimilarity metric with the coding performance. With accurate depth maps, we can compute the inter-view similarity exactly [21] as the correlation between views is driven by the geometry information. The similarity between views can be related to the image region that is common in two views.…”

Section: A Dissimilarity Metricmentioning

confidence: 99%

“…The views have sub-sampled irregularly. In particular, we have selected 25 views, namely, 1,5,9,13,17,18,21,24,27,30,33,36,37,39,41,42,43,44,45,46,47,48,49,50,51, in the dataset of [36]. We have also tested our solution on a challenging test sequence, called new Tsukuba [39].…”

Section: B Applications To Existing Codersmentioning

confidence: 99%

“…We then test our reference view selection algorithm in coding experiments with both the 3DVC framework [20] and a state-ofthe-art multiview DSC algorithm proposed in [21], [22]. The latter consists in using depth images for correlation estimation at the encoder side, and side information generation at the decoder side.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Reference View Selection in DIBR-Based Multiview Coding

Maugey

Petrazzuoli

Frossard

et al. 2016

IEEE Trans. on Image Process.

Self Cite

View full text Add to dashboard Cite

Abstract-Augmented reality, interactive navigation in 3D scenes, multiview video and other emerging multimedia applications require large sets of images hence larger data volumes and increased resources compared to traditional video services. The significant increase of the number of images in multiview systems leads to new challenging problems in data representation and data transmission to provide high quality of experience on resource-constrained environments. In order to reduce the size of the data, different multi view video compression strategies have been proposed recently. Most of them use the concept of reference or key views that are used to estimate other images when there is high correlation in the dataset. In such coding schemes, the two following questions become fundamental: i) how many reference views have to be chosen for keeping a good reconstruction quality under coding cost constraints? ii) where to place these key views in the multiview dataset? As these questions are largely overlooked in the literature, we study the reference view selection problem and propose an algorithm for the optimal selection of reference views in multiview coding systems. Based on a novel metric that measures the similarity between the views, we formulate an optimization problem for the positioning of the reference views such that both the distortion of the view reconstruction and the coding rate cost are minimized. We solve this new problem with a shortest path algorithm that determines both the optimal number of reference views and their positions in the image set. We experimentally validate our solution in a practical multiview distributed coding system and in the standardized 3D-HEVC multi view coding scheme. We show that considering the 3D scene geometry in the reference view positioning problem brings significant rate-distortion improvements and outperforms traditional coding strategy that simply selects key frames based on the distance between cameras.Index Terms-Multiview distributed coding, key view positioning, inter-view correlation, view synthesis, multiview image coding

show abstract

Section: A Dissimilarity Metricmentioning

confidence: 99%