Turning Diffusion-Based Image Colorization Into Efficient Color Compression

Abstract

The work of Levin et al. (2004) popularized stroke-based methods that add color to gray value images according to a small amount of user-specified color samples. Even though such reconstructions from sparse data suggest a possible use in compression, only few attempts were made so far in this direction. Diffusion-based compression methods pursue a similar idea: they store only few image pixels and inpaint the missing regions. Despite this close relation and a lack of diffusion-based color codecs, colorization ideas were so far only integrated into transform-based approaches such as JPEG. We address this missing link with two contributions. First, we show the relation between the discrete colorization of Levin et al. and continuous diffusion-based inpainting in the YCbCr color space. It decomposes the image into a luma (brightness) channel and two chroma (color) channels. Our luma-guided diffusion framework steers the diffusion inpainting in the chroma channels according to the structure in the luma channel. We show that making the luma-guided colorization anisotropic outperforms the method of Levin et al. significantly. Second, we propose a new luma preference codec that invests a large fraction of the bit budget into an accurate representation of the luma channel. This allows a high-quality reconstruction of color data with our colorization technique. Simultaneously, we exploit the fact that the human visual system is more sensitive to structural than to color information. Our experiments demonstrate that our new codec outperforms the state of the art in diffusion-based image compression and is competitive to transform-based codecs.

Exemplar-Based Face Colorization Using Image Morphing

“…Variational approaches are frequently applied in image colorization either directly or as a post-processing step, see, e.g., [1,3,44]. For instance, the technique of Gupta et al [6] uses the chrominance diffusion approach of Levin et al [1].…”

Image Coding with Neural Network-Based Colorization

“…The selected colors are exploited as cues by the neural network and effectively propagated for the entire image, significantly improving the color quality. Although in the past, traditional colorization methods were integrated into transform-based approaches such as JPEG [9][10] to improve coding efficiency, deep learning-based colorization methods were never exploited for the same purpose, to the best of our knowledge. In the next section, a novel image coding solution integrating a deep learning-based colorizer is proposed.…”

Novel hybrid framework for image compression for supportive hardware design of boosting compression

“…Work in this direction has been carried out by Chen et al [26] where Golomb Rice is considered for implementation for enhancing the compression efficiency. The problems associated with color compression is carried out by Peter et al [27] where the authors have used diffusion-based approach along with inpainting phenomenon for offering superior quality of reconstructed image.…”