A Real-Time Target Tracking Algorithm for a Robotic Flexible Endoscopy Platform

Abstract

Complex endoscopic interventions require a new generation of devices and instruments. A robotic platform for flexible endoscopy through telemanipulation was developed to meet this demand. The concept of telemanipulation allows the development of software for computer-aided surgery. Intelligent navigation such as automated target centralization could assist the endoscopist during procedures.A real-time algorithm was designed for tracking a target region that is of specific interest for the surgeon. Therefore, the physician needs to indicate the region to be tracked, which then will be centralized (locked). The goal of this research is to investigate the robustness and accuracy of the tracking algorithm during endoscopic interventions. The region of interest can be a polyp for polypectomy, Vater's ampulla for Endoscopic Retrograde CholangioPancreatography (ERCP), Barrett's epithelia for gastroscopic biopsy or any area in more complex procedures. The algorithm was tested in vitro on image sequences obtained during real endoscopic interventions.The indicated area of interest could be tracked in all image sequences, with an accuracy of 91.6 % (Q1-Q3 77.7 %-99.0 %, intraclass correlation). The algorithm was robust against instruments or smoke in the field of view. Tracking was less robust against very large camera movements.The developed target lock worked robustly, in real-time and was found to be accurate. Improvements include improving the robustness of the algorithm against motion blur and drift.

Development of Haptic Approaches for a Head-Controlled Soft Robotic Endoscope

“…Looking into other limitations in MIS, a better control method is needed to reduce the dependencies on the communication between surgeon and the assistant who controls the endoscope during an intervention. Several solutions had been proposed to move the control from the assistant to the surgeon directly, such as single-hand controlled [10], body controlled [11], eye-movement controlled [12], image-guided [13] [14], and lastly a head-controlled endoscope system, [15] which is relevant to the control approach used in this study.…”