Bridging the gap between formal and experience-based knowledge for context-aware laparoscopy

Abstract

Formal and experience-based knowledge can be successfully combined for robust phase recognition.

Design and Integration of Electrical Bio-impedance Sensing in Surgical Robotic Tools for Tissue Identification and Display

“…As reported by Penza et al (2014), additional assistive technologies such as multimodal data registration and image guided navigation systems are very helpful in these complex conditions. Also, a study by Katić et al (2016) introduced a method for providing surgical context awareness by identifying surgical activity and retrieving anatomical structures in the image. Alternatively, another study by Moccia et al (2018) proposed to use deep learning approach for identifying different tissue types in endoscopic video images.…”

Surgical data science for next-generation interventions

“…In the operating room, application can include monitoring procedures to predict remaining duration to facilitate scheduling or to anticipate needs for resources (16). Similarly, autonomous assistance can provide surgeons with timely information through surgical phase recognition (17,18), decision-support through patient-specific simulations (19), and collaborative robots (20). Context-aware assistance improves the safety, quality, and efficiency of care and can augment providers' performance when integrated into surgical care pathways.…”

Uncertainty-Aware Organ Classification for Surgical Data Science Applications in Laparoscopy

“…Contributions in the field include [19], [3]. The AR systems in [19], [3] provide context awareness by identifying surgical phases based on (i) surgical activity, (ii) instruments and (iii) anatomical structures in the image. This is something that is commonly assumed as standard [20].…”

“…Accordingly, 55 Spx on average were obtained for each image. The LBP R,P riu2 were computed considering the following (R, P ) combinations: (1,8), (2,16), and (3,24). The feature vector for an Spx was obtained by concatenating the H LBP with the AS value for all 8 multispectral channels (for MI) and for λ i = 700, 560 and 470 nm (for RGB).…”

“…In laparoscopy, some of the major opportunities that SDS offers to improve surgical outcomes are surgical decision support [2] and context awareness [3]. Here, technical challenges include the detection and localization of anatomical structures and surgical instrumentation, intra-operative registration, and workflow modeling and recognition.…”