Luminance Compensation MEMC for Video Frame Interpolation

Abstract

Video frame interpolation is an important technology in digital video processing, which has great impact on users' viewing experience. In particular, in medical or industrial application scenarios, the accuracy of the frame interpolation algorithm may also influence the diagnosis results. In addition, for videos based on ionizing radiation (e.g., X-rays), each frame exposure could cause damage to human tissues by ionizing radiation. Therefore, if a frame interpolation algorithm is introduced to display the same number of frames, it only needs to sample half of the frames and halve the exposure radiation doses, which is statistically promising to reduce human cancer rate caused by ionizing radiations (e.g., medical examinations). However, since there are errors in frame interpolation caused by luminance leap, existing works are not applicable in such scenarios. To solve this problem, this paper proposes a video interpolation algorithm based on luminance compensation MEMC (LC-MEMC). Firstly, a luminance compensation method based on the electromagnetic irradiation attenuation in human tissue is introduced to improve the performance of motion estimation and motion compensation (MEMC) and reduce matching errors caused by luminance leap. Secondly, LC-MEMC proposes an improved block matching approach, including i) a new search method from basic points to local points and ii) a block matching criterion that simplifies the calculation process. LC-MEMC improves the accuracy and processing speed of video interpolation from three perspectives: adding luminance compensation, improving the search strategy and optimizing the matching degree calculation method for each search position. We evaluated LC-MEMC on collected medical videos and achieved higher accuracy, faster processing speed, and significantly better viewing experience comparing with existing methods.