Adaptive recovery of motion blur point spread function from differently exposed images

Abstract

Motion due to digital camera movement during the image capture process is a major factor that degrades the quality of images and many methods for camera motion removal have been developed. Central to all techniques is the correct recovery of what is known as the Point Spread Function (PSF). A very popular technique to estimate the PSF relies on using a pair of gyroscopic sensors to measure the hand motion. However, the errors caused either by the loss of the translational component of the movement or due to the lack of precision in gyro-sensors measurements impede the achievement of a good quality restored image. In order to compensate for this, we propose a method that begins with an estimation of the PSF obtained from 2 gyro sensors and uses a pair of under-exposed image together with the blurred image to adaptively improve it. The luminance of the under-exposed image is equalized with that of the blurred image. An initial estimation of the PSF is generated from the output signal of 2 gyro sensors. The PSF coefficients are updated using 2D-Least Mean Square (LMS) algorithms with a coarse-to-fine approach on a grid of points selected from both images. This refined PSF is used to process the blurred image using known deblurring methods. Our results show that the proposed method leads to superior PSF support and coefficient estimation. Also the quality of the restored image is improved compared to 2 gyro only approach or to blind image de-convolution results.

Autofocus System and Evaluation Methodologies: A Literature Review

“…Fortunately, camera makers have already incorporated such a feature in some of their highend products. Typical examples are the artificial intelligence (AI) servo of Canon's DSLR (56,57) continuous focus (AF-C) of Nikon's DSLR, (58) and trap focus (59) and a moving detection device to follow the movement of a subject and focus on it simultaneously (45) by FLIR systems. Zoom tracking, a method of continuous focusing on a moving subject along the camera's optical axis during zooming operation, was also described.…”

Non‐uniform image blind deblurring by two‐stage fully convolution network

“…Some of the prior‐knowledge‐based methods follow the pipeline of firstly estimate blur kernel and secondly remove the blur. Kernel can be estimated by analysing image statistics [4], blur spectrum [5], hand‐crafted features [6], or other prior knowledge [7]. Once the kernels are obtained for each local region of a blurry image, the blurry image is then deblurred by using patch statics‐based methods.…”

Multiregression spatially variant blur kernel estimation based on inter‐kernel consistency

“…However, SR models suffer from performance degradation in a real-world environment where the blur kernel is unknown. An adaptive filtering approach [4] was proposed to enhance the blurred image using a pair of under-exposed images together with the blurred image. Moreover, other methods [5][6][7], which predict the blur kernel from the LR image, were proposed to predict the blur kernel.…”