Content-adaptive depth map enhancement based on motion distribution

Lee, Gwo Giun Chris; Li, Bo-Syun; Chen, Chun-Fu

doi:10.1109/vcip.2014.7051611

Cited by 1 publication

(2 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The temporal consistency of depth maps is often achieved through the use of additional refinement [62], [66]. Such refinement methods are usually based on the estimation and segmentation of the background of a scene.…”

Section: State-of-the-art-depth Estimation Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Depth Map Estimation for Free-Viewpoint Television and Virtual Navigation

2020

View full text Add to dashboard Cite

The paper presents a new method of depth estimation, dedicated for free-viewpoint television (FTV) and virtual navigation (VN). In this method, multiple arbitrarily positioned input views are simultaneously used to produce depth maps characterized by high interview and temporal consistencies. The estimation is performed for segments and their size is used to control the trade-off between the quality of depth maps and the processing time of depth estimation. Additionally, an original technique is proposed for the improvement of temporal consistency of depth maps. This technique uses the temporal prediction of depth, thus depth is estimated for P-type depth frames. For such depth frames, temporal consistency is high, whereas estimation complexity is relatively low. Similarly, as for video coding, I-type depth frames with no temporal depth prediction are used in order to achieve robustness. Moreover, we propose a novel parallelization technique that significantly reduces the estimation time. The method is implemented in C++ software that is provided together with this paper, so other researchers may use it as a new reference for their future works. In performed experiments, MPEG methodology was used whenever possible. The provided results demonstrate the advantages over the Depth Estimation Reference Software (DERS) developed by MPEG. The fidelity of a depth map, measured by the quality of synthesized views, is higher on average by 2.6 dB. This significant quality improvement is obtained despite a significant reduction of the estimation time, on average 4.5 times. The application of the proposed temporal consistency enhancement method increases this reduction to 29 times. Moreover, the proposed parallelization results in the reduction of the estimation time up to 130 times (using 6 threads). As there is no commonly accepted measure of the consistency of depth maps, the application of compression efficiency of depth is proposed as a measure of depth consistency.

show abstract

Section: State-of-the-art-depth Estimation Methodsmentioning

confidence: 99%

“…Therefore, through this paper, the quality of the depth maps is represented by the quality of the virtual views synthesized using these depth maps. Such an approach is common in research on depth map estimation [61], [62], and was also proposed as a part of the 3D framework of the ISO/IEC MPEG group [60].…”

Section: Introductionmentioning

confidence: 99%