In this paper, we propose a real-time temporal synchronization and compensation algorithm in stereoscopic video. Many temporal asynchronies are caused in the video editing stage and due to different transmission delays. These temporal asynchronies can degrade the perceived 3D quality. The goal of temporal alignment is to detect and to measure the temporal asynchrony and recover synchronization of the two video streams. In order to recover synchronization of the two video streams, we developed a method to detect asynchronies between the left and the right video streams based on a novel spatiogram information, which is a richer representation, capturing not only the values of the pixels but their spatial relationships as well. The proposed novel spatiogram additionally includes the changes of the spatial color distribution. Furthermore, we propose a block-based method for detection of the pair frame instead of one frame-based method. Various 3D experiments demonstrate the effectiveness of the proposed method.

In this paper, a real-time dual-mode temporal synchronization and compensation method based on a new reliability measure in stereoscopic video is proposed. The goal of temporal alignment is to detect the temporal asynchrony and recover synchronization of the two video streams. The accuracy of the temporal synchronization algorithm depends on the 3DTV contents. In order to compensate the temporal synchronization error, it is necessary to judge whether the result of the temporal synchronization is reliable or not. Based on our recently developed temporal synchronization method[1], we define a new reliability measure for the result of the temporal synchronization method. Furthermore, we developed a dual-mode temporal synchronization method, which uses a usual texture matching method and the temporal spatiogram method [1]. The new reliability measure is based on two distinctive features, a dynamic feature for scene change and a matching distinction feature. Various experimental results show the effectiveness of the proposed method. The proposed algorithms are evaluated and verified through an experimental system implemented for 3DTV.