INTRODUCTION
Minimally invasive surgery (MIS) is considered superior to open surgery because of the reduced recovery times, pain medication, and infection rates. However, the smaller surgical site increases the surgical difficulty as physical landmarks are no longer visible. Using an augmented reality (AR) overlay where a patient's CT or MRI information is registered to the physical patient, users would be able to view the internal patient anatomy while maintaining a small surgical site. Our goal is to determine how to best render the virtual information intuitively for surgeons while operating MIS cases.
METHODS
Given AR systems available today, there are many options regarding rendering virtual objects. Using the Microsoft HoloLens, we virtually overlay two layers of the patient body (soft and hard tissue) and vary the opacity and color in real time. Surgeons wore the headset during nonoperative stages of the surgery and asked usability questions regarding the system.
RESULTS
Users surveyed displayed strong predilection towards more opaque renderings of hard tissue, with an average setting of approximately 95%. Comparatively, users preferred much lower opacity for soft tissue, with an average opacity of 26.88%, and with some users wanting no visualization of soft tissue. It was also found that users at earlier stages in their training (ie, medical students and residents) preferred more contrasting colors, whereas attendings and fellows preferred grey-scaled color profiles analogous to traditional imaging modalities.
CONCLUSION
Based on the results found in the usability testing, it was found that current state-of-the-art AR headsets are not currently well suited for the operating room. Ergonomics, eye fatigue, and changing lighting conditions were all undesirable factors, especially for extended use during surgery. Data gathered from the rendering tests and pain points will be further addressed in the next generation of AR headsets.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.