A high-speed hyperspectral laparoscopic imaging system

Pruitt, Kelden; Johnson, Brett A.; Gahan, Jeffrey; Li, Ma; Fei, Baowei

doi:10.1117/12.2653922

Cited by 3 publications

(3 citation statements)

References 48 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Smaller elements and groups of the resolution target were analyzed until the contrast threshold was surpassed. Contrast was analyzed on full resolution demosaic images outlined in our previous work, including lowpass filtering and white reference calibration demosaicing [15], as well as the newly proposed filter-convolution method.…”

Section: Discussionmentioning

confidence: 99%

“…Overall, the dual-camera, high-speed HSI configuration has yet to be fully developed, integrated, and applied in a single system. Our work is to this end and builds upon our previous work [15] by widening the spectral range that can be analyzed by the system through the additional hyperspectral camera with little cost in acquisition speed. This is done not only through an improved hardware design, but also through the development of an application to interface with the system.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A dual-camera hyperspectral laparoscopic imaging system

Pruitt,

Rathgeb,

Gahan

et al. 2024

Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XXII

Self Cite

View full text Add to dashboard Cite

Minimally invasive surgery (MIS) has expanded broadly in the field of abdominal and pelvic surgery. However, there are still prevalent issues surrounding intracorporeal surgery, such as iatrogenic injury, anastomotic leakage, or the presence of positive tumor margins after resection. Current approaches to address these issues and advance laparoscopic imaging techniques often involve fluorescence imaging agents, such as indocyanine green (ICG), to improve visualization, but these have drawbacks. Hyperspectral imaging (HSI) is an emerging optical imaging modality that takes advantage of spectral characteristics of different tissues. Various applications include tissue classification and digital pathology. In this study, we developed a dual-camera system for high-speed hyperspectral imaging. This includes the development of a custom application interface and corresponding hardware setup. Characterization of the system was performed, including spectral accuracy and spatial resolution, showing little sacrifice in speed for the approximate doubling of the covered spectral range, with our system acquiring 29 spectral images from 460-850 nm. Reference color tiles with various reflectance profiles were imaged and a RMSE of 3.56 ± 1.36% was achieved. Sub-millimeter resolution was shown at 7 cm working distance for both hyperspectral cameras. Finally, we image ex vivo tissues, including porcine stomach, liver, intestine, and kidney with our system and use a high-resolution, radiometrically calibrated spectrometer for comparison and evaluation of spectral fidelity. The dual-camera hyperspectral laparoscopic imaging system can have immediate applications in various surgeries.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

A dual-camera hyperspectral laparoscopic imaging system

Pruitt,

Rathgeb,

Gahan

et al. 2024

Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XXII

Self Cite

View full text Add to dashboard Cite

show abstract

“…𝐼𝐼 𝑑𝑑𝑟𝑟𝑟𝑟𝑑𝑑 is the dark reference, 𝐼𝐼 𝑟𝑟ℎ𝑖𝑖𝑖𝑖𝑖𝑖 is the white reference image, and 𝐼𝐼 is the final corrected image. The raw image is a mosaiced image, so we used our demosaicing method to produce final hyperspectral images [15]. The raster resolution of an RGB image is 3072 × 2048 × 3 pixels, and the raster resolution of a hyperspectral image is 512 × 270 × 16 pixels.…”

Section: Image Acquisition and Analysismentioning

confidence: 99%

A high-resolution hyperspectral imaging system for retina imaging

Tran,

Bryarly,

Pruitt

et al. 2024

Optical Biopsy XXII: Toward Real-Time Spectroscopic Imaging and Diagnosis

View full text Add to dashboard Cite

In this study, we developed an imaging system that can acquire and produce high-resolution hyperspectral images of the retina. Our system combines the view from a high-resolution RGB camera and a snapshot hyperspectral camera together. The method is fast and can be constructed into a compact imaging device. We tested our system by imaging a calibrated color chart, biological tissues ex vivo, and a phantom of the human retina. By using image pansharpening methods, we were able to produce a high-resolution hyperspectral image. The images from the hyperspectral camera alone have a spatial resolution of 0.2 mm/pixel, whereas the pansharpened images have a spatial resolution of 0.1 mm/pixel, a 2x increase in spatial resolution. Our method has the potential to capture images of the retina rapidly. Our method preserves both the spatial and spectral fidelity, as shown by comparing the original hyperspectral images with the pansharpened images. The high-resolution hyperspectral imaging device can have a variety of applications in retina examinations.

show abstract

Design and validation of a high-speed hyperspectral laparoscopic imaging system

Pruitt,

Ma,

Rathgeb

et al. 2024

J. Biomed. Opt.

View full text Add to dashboard Cite

. Significance Minimally invasive surgery (MIS) has shown vast improvement over open surgery by reducing post-operative stays, intraoperative blood loss, and infection rates. However, in spite of these improvements, there are still prevalent issues surrounding MIS that may be addressed through hyperspectral imaging (HSI). We present a laparoscopic HSI system to further advance the field of MIS. Aim We present an imaging system that integrates high-speed HSI technology with a clinical laparoscopic setup and validate the system’s accuracy and functionality. Different configurations that cover the visible (VIS) to near-infrared (NIR) range of electromagnetism are assessed by gauging the spectral fidelity and spatial resolution of each hyperspectral camera. Approach Standard Spectralon reflectance tiles were used to provide ground truth spectral footprints to compare with those acquired by our system using the root mean squared error (RMSE). Demosaicing techniques were investigated and used to measure and improve spatial resolution, which was assessed with a USAF resolution test target. A perception-based image quality evaluator was used to assess the demosaicing techniques we developed. Two configurations of the system were developed for evaluation. The functionality of the system was investigated in a phantom study and by imaging ex vivo tissues. Results Multiple configurations of our system were tested, each covering different spectral ranges, including VIS (460 to 600 nm), red/NIR (RNIR) (610 to 850 nm), and NIR (665 to 950 nm). Each configuration is capable of achieving real-time imaging speeds of up to 20 frames per second. RMSE values of , , and 3.47% were achieved for the VIS, RNIR, and NIR systems, respectively. We obtained sub-millimeter resolution using our demosaicing techniques. Conclusions We developed and validated a high-speed hyperspectral laparoscopic imaging system. The HSI system can be used as an intraoperative imaging tool for tissue classification during laparoscopic surgery.

show abstract

A high-speed hyperspectral laparoscopic imaging system

Cited by 3 publications

References 48 publications

A dual-camera hyperspectral laparoscopic imaging system

A dual-camera hyperspectral laparoscopic imaging system

A high-resolution hyperspectral imaging system for retina imaging

Design and validation of a high-speed hyperspectral laparoscopic imaging system

Contact Info

Product

Resources

About