Improved Ct-MR Image Fusion Scheme Using Dual Tree Complex Contourlet Transform Based on Pca

Abstract

Medical image fusion has been used to derive useful information from multimodality medical image data. This paper presents a dual-tree complex contourlet transform (DT-CCT) based approach for the fusion of magnetic resonance image (MRI) and computed tomography (CT) image. The objective of the fusion of an MRI and a CT image of the same organ is to obtain a single image containing as much information as possible about that organ for diagnosis. The limitation of directional information of dual-tree complex wavelet (DT-CWT) is rectified in DT-CCT by incorporating directional filter banks (DFB) into the DT-CWT. To improve the fused image quality, we propose a new method for fusion rules based on the principle component analysis (PCA) which depend on frequency component of DT-CCT coefficients (contourlet domain). For low frequency coefficients, PCA method is adopted and for high frequency coefficients, the salient features are picked up based on local energy. The final fusion image is obtained by directly applying inverse dual tree complex contourlet transform (IDT-CCT) to the fused low and high frequency coefficients. The DT-CCT produces images with improved contours and textures, while the property of shift invariance is retained. The experimental results showed that the proposed method produces fixed image with extensive features on multimodality.

Application of Image Fusion in Diagnosis and Treatment of Liver Cancer

“…In the medical field, PCA has been applied in the fusion of MRI, CT, PET and US [41][42][43]. PCA can also combine with decomposition methods, such as IHS, the pyramid method, Discrete wavelet transform [44], the Curvelet transform, Contourlet transform [45] and Non-Subsampled Contourlet transform [31,[46][47][48][49][50][51][52][53][54][55][56].…”

“…For the fusion of CT and MRI in real clinical applications, the common methods are Arithmetic combination [177], the PCA-wavelet transformation-based method [47][48][49]53,54,56,117] and the Pyramid method [58,59]. Here, we show one real clinical example for the assessment of the cryoablation margin using MRI-CT fusion imaging in hepatic malignancies [180].…”

Medical Image Fusion Schemes Using Contourlet Transform and PCA Bases

“…Dual tree complex contourlet transform based on PCA is implemented as described in (Al-Azzawi et al, 2009;Al-Azzawi and Abdullah, 2010). PCA is also called the Karhunen-Loève transform or the Hotelling transform.…”

Image Fusion and Its Applications

“…The principal component analysis PCA can be used as a weighted precision measure to determine which pixel or region is important for fused. Dual tree complex contourlet transform based on PCA is implemented as described in (Al-Azzawi et al, 2009;Al-Azzawi and Abdullah, 2010). PCA is also called the Karhunen-Loève transform or the Hotelling transform.…”