Video Frame Interpolation: A Comprehensive Survey

Abstract

Video Frame Interpolation (VFI) is a fascinating and challenging problem in the computer vision (CV) field, aiming to generate non-existing frames between two consecutive video frames. In recent years, many algorithms based on optical flow, kernel, or phase information have been proposed. In this paper, we provide a comprehensive review of recent developments in the VFI technique. We first introduce the history of VFI algorithms’ development, the evaluation metrics, and publicly available datasets. We then compare each algorithm in detail, point out their advantages and disadvantages, and compare their interpolation performance and speed on different remarkable datasets. VFI technology has arisen continuous attention in the CV community, some video processing applications based on VFI are also mentioned in this survey, such as slow-motion generation, video compression, video restoration. Finally, we outline the bottleneck faced by the current video frame interpolation technology and discuss future research work.

Compressive Video via IR-Pulsed Illumination

“…Inspired by frame interpolation (FI) methods [27], we can implement this system as a hybrid acquisition where g 1 = 𝑓 1 and g 3 = 𝑓 𝑁 𝐹 are key-frames and g 2 contains a compressive measurement of all frames in between. Thus, we update Eq.…”

Compressive Video via IR-Pulsed Illumination

“…Inspired by frame interpolation (FI) methods [27], we can implement this system as a hybrid acquisition where g 1 = 𝑓 1 and g 3 = 𝑓 𝑁 𝐹 are key-frames and g 2 contains a compressive measurement of all frames in between. Thus, we update Eq.…”