A Deep Image Prior Learning Algorithm for Joint Selective Segmentation and Registration

Burrows, Liam; Chen, Ke; Torella, Francesco

doi:10.1007/978-3-030-75549-2_33

Cited by 1 publication

(1 citation statement)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [1,2] the authors fit an untrained network to a single degraded image, addressing several problems such as image denoising, image restoration, inpainting and superresolution. Moreover, DIP has found successful practical applications in other imaging domain such as blind deconvolution [4][5][6], image segmentation [7,8], medical imaging [9,10].…”

Section: Introductionmentioning

confidence: 99%

Early stopping strategies in Deep Image Prior

Benfenati,

Catozzi,

Franchini

et al. 2024

Preprint

View full text Add to dashboard Cite

The so-called Deep Image Prior approach is an unsupervised deep learning methodology which has gained great interest in recent years due to its effectiveness in tackling imaging problems. However, a well known drawback of Deep Image Prior is the need for a proper early stopping technique to prevent undesired corruptions in the reconstructed images. Determining the optimal number of iterations depends on both the specific application and the features of the images being processed. As a consequence, several numerical trials are typically required to decide when to stop the Deep Image Prior procedure, resulting in significant computational costs and time requirements. This paper aims to introduce two early stopping techniques for Deep Image Prior, based on different approaches and different perspectives. The first one relies on the Neural Architecture Search strategy by generating hyperparameters configurations for the neural network employed in Deep Image Prior, configurations that shall be able to provide clean images comparable to those obtained by the standard configuration, optimally stopped, but with significantly fewer iterations. The second proposed early stopping strategy is based on a modified version of the BRISQUE metric, a no-reference image quality measure, and it aims to track the behaviour of the PSNR curve, obtained by applying Deep Image Prior, without knowing the ground truth image. While the NAS-based early stopping technique is particularly suited in those situations where the computational time is limited, this latter one is also relevant when a larger number of iterations is allowed. Several numerical experiments on different denoising applications show a promising performance of Deep Image Prior combined with the suggested early stopping procedures.

show abstract