Image enhancement based on<i>in vivo</i>hyperspectral gastroscopic images: a case study

Gu, Xiaozhou; Han, Zhen; Yao, Ling; Zhong, Yunshi; Shi, Qiang; Fu, Ye; Liu, Changsheng; Wang, Xi-guang; Xie, Tianyu

doi:10.1117/1.jbo.21.10.101412

Cited by 24 publications

(15 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As suggested above, an SRDA could therefore be integrated as a "chip-on-tip" at the distal end of a commercial endoscope in future. This is beneficial when compared to multispectral systems based on filter wheels 21,30,31 and tunable filters, 23,32 which sacrifice temporal resolution to sequentially acquire spectral data. Sequential acquisition of spectral data can also introduce motion artifacts between sequentially acquired spectral band images.…”

Section: Discussionmentioning

confidence: 99%

“…Spectral imaging is typically achieved by filtering the light on either the illumination or detection side. Filtering has been achieved by the use of: a set of dichroic beamsplitters and dedicated detectors; 10,27,29 a filter wheel with a set of bandpass filters; 21,30,31 tunable filters; 23,32 or a monochromator. 33 Alternatively, a set of laser lines may be used for illumination.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Bimodal reflectance and fluorescence multispectral endoscopy based on spectrally resolving detector arrays

et al. 2018

View full text Add to dashboard Cite

Emerging clinical interest in combining standard white light endoscopy with targeted near-infrared (NIR) fluorescent contrast agents for improved early cancer detection has created demand for multimodal imaging endoscopes. We used two spectrally resolving detector arrays (SRDAs) to realize a bimodal endoscope capable of simultaneous reflectance-based imaging in the visible spectral region and multiplexed fluorescencebased imaging in the NIR. The visible SRDA was composed of 16 spectral bands, with peak wavelengths in the range of 463 to 648 nm and full-width at half-maximum (FWHM) between 9 and 26 nm. The NIR SRDA was composed of 25 spectral bands, with peak wavelengths in the range 659 to 891 nm and FWHM 7 to 15 nm. The spectral endoscope design was based on a "babyscope" model using a commercially available imaging fiber bundle. We developed a spectral transmission model to select optical components and provide reference endmembers for linear spectral unmixing of the recorded image data. The technical characterization of the spectral endoscope is presented, including evaluation of the angular field-of-view, barrel distortion, spatial resolution and spectral fidelity, which showed encouraging performance. An agarose phantom containing oxygenated and deoxygenated blood with three fluorescent dyes was then imaged. After spectral unmixing, the different chemical components of the phantom could be successfully identified via majority decision with high signal-to-background ratio (>3). Imaging performance was further assessed in an ex vivo porcine esophagus model. Our preliminary imaging results demonstrate the capability to simultaneously resolve multiple biological components using a compact spectral endoscopy system.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Bimodal reflectance and fluorescence multispectral endoscopy based on spectrally resolving detector arrays

et al. 2018

View full text Add to dashboard Cite

show abstract

“…First, we built an HSI endoscopy system containing 31 narrow-band filters [11,12,13]. The center wavelength of passband of these filters are from 400 nm to 700 nm, with bandwidth and wavelength increment of 10 nm.…”

Section: Methodsmentioning

confidence: 99%

A Novel Hyperspectral Endoscopic Imaging Method Based on Broad- and Overlapped-Band Filters

Han

Xie

Zhang

2017

2017 Design of Medical Devices Conference

Self Cite

View full text Add to dashboard Cite

In medical domain, hyperspectral imaging (HSI) [1] offers a hybrid modality of optical diagnostics that obtains spectral information and renders the information in image form, thus it has great potential for noninvasive disease diagnosis and surgical guidance [2]. Masood [3] explored a series of research problems for classification of hyperspectral (HS) colon biopsy images, and concluded that HSI has enough discriminatory power to distinguish normal and malignant biopsy tissues. However, HS illumination is always with low intensity and signal-to-noise (SNR) ratio is low for HS images. The reason is that sensors of endoscopic systems, such as charged-couple-device (CCD), work by converting photons into electrons which are then stored in each pixel. The number of electrons stored in each pixel well is proportional to the number of photons that struck that pixel, although in actual pixel well, electrons are not only generated when receiving photons, but also due to physical processes within CCD itself, such as thermal noise which generates additional electrons dependent to temperature [4,5]. At the same time, dispersive device such as monochromators (such as prism and grating), and optical filters (including interference filters and tunable filters) are commonly used for HS imaging. Using these traditional filtering approaches, only a low fractions of photons are transmitted into the sensor. Moreover, due to the requirements of safety and keeping the working time per frame as short as possible for in-vivo and real-time application in medical domain, common methods which could improve SNR, such as using cooled sensor or high exposure time, are not applicable for HS endoscopy systems. To overcome this drawback, we proposed this novel HS imaging method based on broad- and overlapped-band filters [6].

show abstract

“…These three bands are then used to create an enhanced RGB image for better visualization. The system has been tested for ulcer detection [12].…”

Section: Introductionmentioning

confidence: 99%

Pre-Cancerous Stomach Lesion Detections with Multispectral-Augmented Endoscopic Prototype

Krebs¹,

Benezeth²,

Bazin

et al. 2020

Applied Sciences

View full text Add to dashboard Cite

In this paper, we are interested in the in vivo detection of pre-cancerous stomach lesions. Pre-cancerous lesions are unfortunately rarely explored in research papers as most of them are focused on cancer detection or conducted ex-vivo. For this purpose, a novel prototype is introduced. It consists of a standard endoscope with multispectral cameras, an optical setup, a fiberscope, and an external light source. Reflectance spectra are acquired in vivo on 16 patients with a healthy stomach, chronic gastritis, or intestinal metaplasia. A specific pipeline has been designed for the classification of spectra between healthy mucosa and different pathologies. The pipeline includes a wavelength clustering algorithm, spectral features computation, and the training of a classifier in a “leave one patient out” manner. Good classification results, around 80%, have been obtained, and two attractive wavelength ranges were found in the red and near-infrared ranges: [745, 755 nm] and [780, 840 nm]. The new prototype and the associated results give good arguments in favor of future common use in operating rooms, during upper gastrointestinal exploration of the stomach for the detection of stomach diseases.

show abstract

Image enhancement based onin vivohyperspectral gastroscopic images: a case study

Cited by 24 publications

References 22 publications

Bimodal reflectance and fluorescence multispectral endoscopy based on spectrally resolving detector arrays

Bimodal reflectance and fluorescence multispectral endoscopy based on spectrally resolving detector arrays

A Novel Hyperspectral Endoscopic Imaging Method Based on Broad- and Overlapped-Band Filters

Pre-Cancerous Stomach Lesion Detections with Multispectral-Augmented Endoscopic Prototype

Contact Info

Product

Resources

About