Laplacian based image fusion

Abstract

A fundamental goal in multispectral image fusion is to combine relevant information from multiple spectral ranges while displaying a constant amount of data as a single channel. Because we expect synergy between the views afforded by different parts of the spectrum, producing output imagery with increased information beyond any of the individual imagery sounds simple.While fusion algorithms achieve synergy under specific scenarios, it is often the case that they produce imagery with less information than any single band of imagery. Losses can arise from any number of problems including poor imagery in one band degrading the fusion result, loss of details from intrinsic smoothing, artifacts or discontinuities from discrete mixing, and distracting colors from unnatural color mapping.We have been developing and testing fusion algorithms with the goal of achieving synergy under a wider range of scenarios. This technique has been very successful in the worlds of image blending, mosaics, and image compositing for visible band imagery. The algorithm presented in this paper is based on direct pixel-wise fusion that merges the directional discrete laplacian content of individual imagery bands rather than the intensities directly. The laplacian captures the local difference in the four-connected neighborhood. The laplacian of each image is then mixed based on the premise that image edges contain the most pertinent information from each input image. This information is then reformed into an image by solving the twodimensional Poisson equation.The preliminary results are promising and consistent. When fusing multiple continuous visible channels, the resulting image is similar to grayscale imaging over all of the visible channels. When fusing discontinuous and/or non-visible channels, the resulting image is subtly mixed and intuitive to understand.

Robust multi-modal medical image fusion via anisotropic heat diffusion guided low-rank structural analysis

“…For example, Laplacian pyramid [24] is one of the simple and efficient methods that can be applied to multi-focus image fusion [25] and multi-spectral image fusion [26]. However, such methods tend to involve other irrelevant information, such as artifacts and noise.…”

Multiscale contrast direction adaptive image fusion technique for MWIR-LWIR image pairs and LWIR multifocus infrared images

“…Because of these variances, image pyramids, which are multiscale representations of the images, are proposed for decomposing the image into components that consist of different spatial frequencies [9]. Image pyramids-based techniques are frequently used in fusion [10][11][12]. In the pyramid approach, a set of bandpass filters is used to decompose scene components into groups that have different frequency characteristics.…”

“…A pixel by pixel fusion is applied at Laplacian images of different levels with respect to pixel absolute values. A similar approach is adapted in [11] where pixel-level fusion is applied on Laplacian values of the image by choosing the directional absolute maximum values. Resultant images are reconstructed from fused Laplacian pyramids.…”

Improved Multidimensional Color Image Fusion Based on the Multi-Wavelets

“…Laplacian pyramid method: Laplacian pyramid of an image is a set of bandpass images, in which each is a bandpass filtered copy of its predecessor ,proposed by Se-Hwan et al (2010), Scott and Pusateri (2010) and Indhumadhi and Padmavathi (2011). Band pass copies can be obtained the difference between lowpass images at successive levels of a Gaussian pyramid.…”