Frame concealment algorithm for stereoscopic video using motion vector sharing

Hewage, Chaminda; Worrall, Stewart; Dogan, S.; Kondoz, A.M.

doi:10.1109/icme.2008.4607477

Cited by 38 publications

(25 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…For frame losses in stereo plus depth format, Chung, Sull and Kim [13] use a 3D image warping technique to determine matching pixels between neighbouring views and do the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Hewage et al [14] propose to share motion vectors between the texture and depth videos if a frame from either of them is lost. This method might not be very efficient when a frame contains objects with different textures placed at the same depth.…”

Section: Related Workmentioning

confidence: 99%

Temporal and Inter-View Consistent Error Concealment Technique for Multiview Plus Depth Video

Khattak

Maugey

Hamzaoui

et al. 2016

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

Abstract-Multiview plus depth (MVD) is an emerging video format with many applications, including 3D television and free viewpoint television. During broadcast of compressed MVD video, transmission errors may cause the loss of whole frames, resulting in significant degradation of video quality. Error concealment techniques have been widely used to deal with transmission errors in video communication. However, the existing solutions do not address the requirement that the reconstructed frames be consistent with neighbouring frames, i.e., corresponding pixels have consistent color information. We propose a new consistency model for error concealment of MVD video that allows to maintain a high level of consistency between frames of the same view (temporal consistency) and those of neighbouring views (inter-view consistency). We then propose an algorithm that uses our model to implement concealment in a consistent way. Simulations with the reference software for the Multiview Video Coding project of the Joint Video Team (JVT) of the ISO/IEC MPEG and ITU-T VCEG show that our method outperforms benchmark techniques, including a baseline approach based on the Boundary Matching Algorithm, with respect to both reconstruction quality and view consistency.

show abstract

Section: Related Workmentioning

confidence: 99%

Temporal and Inter-View Consistent Error Concealment Technique for Multiview Plus Depth Video

Khattak

Maugey

Hamzaoui

et al. 2016

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

show abstract

“…여기에서는 오른쪽 뷰 보다 왼 쪽 뷰에 더 높은 우선순위를 매김으로써 UEP 방식을 적용하였다. 아울러 칼라와 깊이 맵 사이의 모션 상관 값을 이용하여 UEP를 실현하는 방법도 제안되었다 [12] . 차원 요소 영상을 기록한다 [3] .…”

Section: 집적 영상 기법에서는unclassified

A Prioritized Transmission Scheme for Three-Dimensional Integral Imaging

Cho

Choi

2014

The Journal of Korea Information and Communications Society

View full text Add to dashboard Cite

Key Words : 3D video, glasses-free, integral image, priority, adaptive modulation ABSTRACTIn this paper, we consider a representative integral imaging method in glasses-free 3D image processing and propose a prioritized transmission scheme for guaranteeing a received video quality in error-prone environments.According to the correlation of pixels consisting of each voxel of integral image, we set the priority differently and apply the modulation level according to this priority value. That is to say, the corresponding pixels with small variance are set to a high priority and transmitted by using a low level modulation that is robust under transmission errors, but the corresponding pixels with greater variance are set to a lower priority and transmitted by using a high level modulation that has a high bit error rate but fast transmission rate. Result shows that the proposed scheme that applies the error-robust modulation level to the important image bit stream with the high priority improves the peak to sidelobe ratio (PSR) of the received 3D image, compared with a typical method that use the same modulation level without distinction of priorities.

show abstract

“…For frame losses in stereo plus depth format, Chung, Sull and Kim [99] use 3D image warping technique to determine matching pixels between neighbouring views and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Hewage et al [39] proposes to share motion vectors between the texture and depth videos in case a frame from either of them is lost. This method might not be very efficient when a frame contains objects with different textures placed at the same depth.…”

Section: Temporal and Inter-view Consistent Error Concealment Techniquementioning

confidence: 99%

“…The first candidate, M B r 1 , is built by using the motion vectors (MVs) of the collocated MB in the corresponding depth frame D v,t as in [39]. This method is named as Depth Motion Vector Sharing (DMS) (See Fig.…”

Section: Candidate Mbs For Reconstructionmentioning

confidence: 99%

See 1 more Smart Citation

Low-complexity multiview video coding

Khattak

Hamzaoui

Ahmad

et al. 2012

2012 Picture Coding Symposium

View full text Add to dashboard Cite

Abstract3D video is a technology that has seen a tremendous attention in the recent years. Multiview Video Coding (MVC) is an extension of the popular H.264 video coding standard and is commonly used to compress 3D videos. It offers an improvement of 20% to 50% in compression efficiency over simulcast encoding of multiview videos using the conventional H.264 video coding standard. However, there are two important problems associated with it: (i) its superior compression performance comes at the cost of significantly higher computational complexity which hampers the real-world realization of MVC encoder in applications such as 3D live broadcasting and interactive Free Viewpoint Television (FTV), and (ii) compressed 3D videos can suffer from packet loss during transmission, which can degrade the viewing quality of the 3D video at the decoder. This thesis aims to solve these problems by presenting techniques to reduce the computational complexity of the MVC encoder and by proposing a consistent error concealment technique for frame losses in 3D video transmission.The thesis first analyses the complexity of the MVC encoder. It then proposes two novel techniques to reduce the complexity of motion and disparity estimation. The first method achieves complexity reduction in the disparity estimation process by exploiting the relationship between temporal levels, type of macroblocks and search ranges while the second method achieves it by exploiting the geometrical relationship between motion and disparity vectors in stereo frames. These two methods are then combined with other state-of-the-art methods in a unique framework where gains add up. Experimental results show that the proposed low-complexity framework can reduce the encoding time of the standard MVC encoder by over 93% while maintaining similar compression efficiency performance.The addition of new View Synthesis Prediction (VSP) modes to the MVC encoding framework improve the compression efficiency of MVC. However, testing additional modes comes at the cost of increased encoding complexity. In order to reduce the encoding complexity, the thesis, next, proposes a bayesian early mode decision technique for a VSP enhanced MVC coder. It exploits the statistical similarities between the RD costs of the VSP SKIP mode in neighbouring views to terminate the mode decision process early. Results indicate that the proposed technique can reduce the encoding time of the enhanced MVC coder by over 33% at similar compression efficiency levels.Finally, compressed 3D videos are usually required to be broadcasted to a large number of users where transmission errors can lead to frame losses which can degrade the video quality at the decoder. A simple reconstruction of the lost frames can lead to inconsistent reconstruction of the 3D scene which may negatively affect the viewing experience of a user. In order to solve this problem, the thesis proposes, at the end, a consistency model for recovering frames lost during transmission. The proposed consistency model is used to evaluate...

show abstract

Frame concealment algorithm for stereoscopic video using motion vector sharing

Cited by 38 publications

References 9 publications

Temporal and Inter-View Consistent Error Concealment Technique for Multiview Plus Depth Video

Temporal and Inter-View Consistent Error Concealment Technique for Multiview Plus Depth Video

A Prioritized Transmission Scheme for Three-Dimensional Integral Imaging

Low-complexity multiview video coding

Contact Info

Product

Resources

About