Colorization is a process of transforming grayscale images to color images in a visually acceptable way. The main goal is to convince a viewer in the authenticity of the result. Grayscale images requiring colorization are in most cases images with natural scenes. Over the past 20 years a wide range of colorization methods has been developedfrom algorithmically simple, yet time-and energy-consuming because of unavoidable human intervention to more complicated, but simultaneously more automated methods. Automatic conversion has become a challenging area that links machine learning and deep learning with art. This paper presents an overview and evaluation of the grayscale image colorization methods and techniques applied to natural images. The paper provides classification of the existing colorization methods, explains the principles which they are based on and emphasizes their advantages and disadvantages. Special focus is put on deep learning methods. Relevant methods are compared regarding image quality and processing time. Different metrics for colored image quality assessment are used in this paper. Measuring the perceived quality of a colored image is extremely challenging because of the complexity of the human visual system. Multiple metrics used for colorization method evaluation provide results by determining the difference between the predicted color value and the ground-truth, which in several cases is not in coherence with image plausibility. The results indicate that user-guided colorization neural networks are the most promising colorization category because of the successful merge of human intervention and neural network automation.
INDEX TERMSAutomatic methods, black-and-white image, colorfulness, colorization, deep learning methods, example-based methods, grayscale image, image quality assessment, scribble-based methods, userguided methods.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.