Real-time Temporal Synchronization and Compensation in Stereoscopic Video

Abstract

In this paper, we propose a real-time temporal synchronization and compensation algorithm in stereoscopic video. Many temporal asynchronies are caused in the video editing stage and due to different transmission delays. These temporal asynchronies can degrade the perceived 3D quality. The goal of temporal alignment is to detect and to measure the temporal asynchrony and recover synchronization of the two video streams. In order to recover synchronization of the two video streams, we developed a method to detect asynchronies between the left and the right video streams based on a novel spatiogram information, which is a richer representation, capturing not only the values of the pixels but their spatial relationships as well. The proposed novel spatiogram additionally includes the changes of the spatial color distribution. Furthermore, we propose a block-based method for detection of the pair frame instead of one frame-based method. Various 3D experiments demonstrate the effectiveness of the proposed method.

A Real-time Dual-mode Temporal Synchronization and Compensation based on Reliability Measure in Stereoscopic Video

“…Based on our recently developed temporal synchronization method[1], we define a new reliability measure for the result of the temporal synchronization method. Furthermore, we developed a dual-mode temporal synchronization method, which uses a usual texture matching method and the temporal spatiogram method [1]. The new reliability measure is based on two distinctive features, a dynamic feature for scene change and a matching distinction feature.…”