Multi-view 3D skin feature recognition and localization for patient tracking in spinal surgery applications

Abstract

Background Minimally invasive spine surgery is dependent on accurate navigation. Computer-assisted navigation is increasingly used in minimally invasive surgery (MIS), but current solutions require the use of reference markers in the surgical field for both patient and instruments tracking. Purpose To improve reliability and facilitate clinical workflow, this study proposes a new marker-free tracking framework based on skin feature recognition. Methods Maximally Stable Extremal Regions (MSER) and Speeded Up Robust Feature (SURF) algorithms are applied for skin feature detection. The proposed tracking framework is based on a multi-camera setup for obtaining multi-view acquisitions of the surgical area. Features can then be accurately detected using MSER and SURF and afterward localized by triangulation. The triangulation error is used for assessing the localization quality in 3D. Results The framework was tested on a cadaver dataset and in eight clinical cases. The detected features for the entire patient datasets were found to have an overall triangulation error of 0.207 mm for MSER and 0.204 mm for SURF. The localization accuracy was compared to a system with conventional markers, serving as a ground truth. An average accuracy of 0.627 and 0.622 mm was achieved for MSER and SURF, respectively. Conclusions This study demonstrates that skin feature localization for patient tracking in a surgical setting is feasible. The technology shows promising results in terms of detected features and localization accuracy. In the future, the framework may be further improved by exploiting extended feature processing using modern optical imaging techniques for clinical applications where patient tracking is crucial.

Automatic image registration on intraoperative CBCT compared to Surface Matching registration on preoperative CT for spinal navigation: accuracy and workflow

“…Adhesive skin markers are used by the augmented reality surgical navigation system (ARSN) commercially known as ClarifEye (Philips, Best, The Netherlands), while Spine Mask (Stryker, Kalamazoo, MI, USA) utilizes LED lights in a frame attached to the patient’s back. Several augmented reality navigation devices use manual image superimposition [ 23 ], while sophisticated surface feature recognition methods have been proposed in experimental models [ 9 , 24 ].…”