Using motion-compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences

Abstract

Abstract-Currently, the most popular method of converting 24 frames per second (fps) film to 60 fields/s video is to repeat each odd-numbered frame for 3 fields and each even-numbered frame for 2 fields. This method is known as 3 : 2 pulldown and is an easy and inexpensive way to perform 24 fps to 60 fields/s frame-rate conversion. However, the 3 : 2 pulldown introduces artifacts, which are especially visible when viewing on progressive displays and during slow-motion playback. We have developed a motion-compensated frame-rate conversion algorithm to reduce the 3 : 2 pulldown artifacts. By using frame-rate conversion with interpolation instead of field repetition, mean square error and blocking artifacts are reduced significantly. The techniques developed here can also be applied to the general frame-rate conversion problem.Index Terms-Film-to-video conversion, frame-rate conversion, motion compensation, spatiotemporal interpolation, video processing, 3:2 pulldown.

Wavelet Pyramid Based Multi-Resolution Bilateral Motion Estimation for Frame Rate Up-Conversion

“…[1]- [3]. The performance of MC-FRUC heavily depends on its two primary steps: motion estimation (ME) and motion compensated interpolation (MCI), especially the former.…”

A Novel Performance Measure for Picture Rate Conversion Methods

“…Also for MCI, a representative metric may assist in speeding up the design phase and allow the evaluation and comparison of various methods. Previous studies proposed to accelerate original video sequences by skipping pictures [4], to reconstruct these by temporal upconversion -using the same factor as for the acceleration -, and to compare the original and the reconstructed pictures through the 'Mean Squared Error' (MSE). Yet, the drawback of this method is that the smallest integer acceleration (a factor of 2) already renders a sequence unrealistic.…”

Motion adaptive interpolation with horizontal motion detection for deinterlacing

“…They used motion-estimation and adaptive interpolation to reconstruct the missing field with the information obtained from the backward and the forward fields. Hilman [10] and Haan [20] proposed a motioncompensated frame-rate conversion algorithm with interpolation to reduce the 3:2 pull-down artifacts. Ville [11] proposed a motion adaptive technique on a fuzzy motion detector.…”