Multifocus image fusion and depth reconstruction

Zhang, Chen; Cui, Jianjiang; Wang, Lihui; Wang, Hao

doi:10.1117/1.jei.29.3.033016

Cited by 2 publications

(1 citation statement)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[9][10][11] Li et al proposed a fusion framework based on a pretrained network (VGG-19). 9,12 First, the source image is decomposed into prominent components (texture and edges) and base components (contours and luminance). Subsequently, deep features are extracted from the prominent components using VGG-19.…”

Section: Introductionmentioning

confidence: 99%

Infrared and visible image fusion method based on hierarchical attention mechanism

Li,

Yan,

Luo

2024

J. Electron. Imag.

View full text Add to dashboard Cite

Currently, most feature extraction methods lack generality and require specific feature extraction methods for images from different sensors, particularly in the detection of faults in power equipment. However, the challenge lies in how to restore realistic texture details while correcting the color distortion. To address this issue, we propose an innovative infrared-visible light image fusion technique that combines hierarchical attention modules and collaborative refinement modules to facilitate feature fusion by jointly preserving intricate details and correcting lighting conditions. The hierarchical attention module aims to provide two different attention weight maps, which help select the most salient information from the source images in the infrared and visible light domains. This ultimately produces intermediate fusion results with comprehensive and complementary data. The collaborative refinement module consists of an edge enhancement network and a lighting correction network, which works together to enhance edge details and correct color differences. Experimental results validate the effectiveness of this method in successfully fusing the two types of images. The results demonstrate that, compared with several mainstream fusion methods, this method exhibits significant advantages in publicly available datasets and scenarios, such as power equipment detection.

show abstract