Reflectance and fluorescence hyperspectral elastic image registration

Abstract

Science and Technology International ® (STI) presents a novel multi-modal elastic image registration approach for a new hyperspectral medical imaging modality. STI's HyperSpectral Diagnostic Imaging (HSDI ® ) cervical instrument is used for the early detection of uterine cervical cancer. A Computer-Aided-Diagnostic (CAD) system is being developed to aid the physician with the diagnosis of pre-cancerous and cancerous tissue regions. The CAD system uses the fusion of multiple data sources to optimize its performance. The key enabling technology for the data fusion is image registration. The difficulty lies in the image registration of fluorescence and reflectance hyperspectral data due to the occurrence of soft tissue movement and the limited resemblance of these types of imagery. The presented approach is based on embedding a reflectance image in the fluorescence hyperspectral imagery. Having a reflectance image in both data sets resolves the resemblance problem and thereby enables the use of elastic image registration algorithms required to compensate for soft tissue movements. Several methods of embedding the reflectance image in the fluorescence hyperspectral imagery are described. Initial experiments with human subject data are presented where a reflectance image is embedded in the fluorescence hyperspectral imagery.

Medical hyperspectral imaging: a review

“…Panasyuk et al 45 performed image registration as a preprocessing step to account for slight motion during the imaging of anesthetized mice. Lange et al 129 developed an elastic image registration algorithm to match reflectance and fluorescence images to compensate for soft tissue movement during the acquisition of reflectance and fluorescence image cubes. A detailed description of image registration algorithms is beyond the scope of this paper.…”

In vivouse of hyperspectral imaging to develop a noncontact endoscopic diagnosis support system for malignant colorectal tumors

“…Noise reduction, contrast enhancement, illumination normalization, reflex removal, and soft image registration for moving objects were performed. [25][26][27][28][29][30]…”

Portable, low-cost multispectral imaging system: design, development, validation, and utilization

“…Indeed, most systems that make such measurements that are in clinical use today are built on a cart. 20,21,38 The small-form factor, light weight, and low power nature of our system allow it to be portable, carried by physicians who move between patients beds or between clinics. If successfully translated and productized, it can have a profound effect on clinical care.…”

“…16 Despite the advantages of multi-and hyperspectral imaging in obtaining clinically relevant information, few commercial systems that can assess oxygen saturation in images exist, and those that are FDA-cleared cost upward of $40,000 and are often difficult to use. [17][18][19] In contrast to these expensive, cart-filled systems from 15 years ago, 20,21 the revolution in consumer electronics has made low-cost cameras and LEDs ubiquitous, bringing down the costs significantly. Several groups and companies have attempted to build a low-cost multispectral imaging system that can quantify scattering and absorption in the tissue, [22][23][24] including some based on LED illumination at various wavelengths, [25][26][27][28] in which spectral data were validated against spectral measurements from existing systems.…”