Multiframe-based bilateral motion estimation with emphasis on stationary caption processing for frame rate up-conversion

Confidence-based adaptive frame rate up-conversion

“…Repetition-based methods and linear interpolation methods have been proposed, and they can be classified as non-motion-compensated approaches [3][4][5][6]. The repetition-based FRU method is quite simple and can be fast worked.…”

“…This weighted median filter is performed based on the hypothesis that the majority of estimated neighboring MVs are likely to be correct. In addition, a weighted zero MV method was proposed to keep consistency of MVs in background regions by giving favors into zero MVs [6,7]. Moglia et al [16] proposed a bi-directional ME which improves the accuracy of motion estimation with backward and forward frames.…”

“…Furthermore, they have the functionality to enhance spatial and temporal resolution during post-processing. Frame rate up-conversion (FRU) methods are suited for the post-processing of display devices for high perceptual quality, as FRU algorithms can enhance temporal quality without increasing the bitrates [1][2][3][4][5][6][7][8][9][10][11][12][13][14].…”

“…Many FRU algorithms have been developed, and they can be classified into two categories [3,[6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21][22]. One approach employs frame repetition or linear interpolation regardless of object motion.…”

“…Therefore, several conventional algorithms employed weighted median filters, weighted zero MVs, and bi-directional motion estimation to refine or select true motion vectors (MVs). As it is hard to achieve satisfactory performance with only one constraint, two or more constraints were used in several conventional algorithms [3][4][5][6][7][8][9]. In order to remove blocking artifacts which are frequently founded at block boundaries in an interpolated frame, an overlapped block motion estimation and compensation (OBME/MC) method can be used.…”