Intraoperative Evaluation of Body Surface Improvement by an Augmented Reality System That a Clinician Can Modify

Abstract

Background:Augmented reality (AR) technology that can combine computer-generated images with a real scene has been reported in the medical field recently. We devised the AR system for evaluation of improvements of the body surface, which is important for plastic surgery.Methods:We constructed an AR system that is easy to modify by combining existing devices and free software. We superimposed the 3-dimensional images of the body surface and the bone (obtained from VECTRA H1 and CT) onto the actual surgical field by Moverio BT-200 smart glasses and evaluated improvements of the body surface in 8 cases.Results:In all cases, the 3D image was successfully projected on the surgical field. Improvement of the display method of the 3D image made it easier to distinguish the different shapes in the 3D image and surgical field, making comparison easier. In a patient with fibrous dysplasia, the symmetrized body surface image was useful for confirming improvement of the real body surface. In a patient with complex facial fracture, the simulated bone image was useful as a reference for reduction. In a patient with an osteoma of the forehead, simultaneously displayed images of the body surface and the bone made it easier to understand these positional relationships.Conclusions:This study confirmed that AR technology is helpful for evaluation of the body surface in several clinical applications. Our findings are not only useful for body surface evaluation but also for effective utilization of AR technology in the field of plastic surgery.

Use of Augmented Reality in Reconstructive Microsurgery: A Systematic Review and Development of the Augmented Reality Microsurgery Score

“…3). [11][12][13][14][15][16][17][18][19][20][21][22][23][24][25][26][27] Articles were excluded if they did not meet the inclusion criteria. In summary, the use of AR in reconstructive microsurgery was explored in five studies, consisting of 30 patients (►Table 2).…”

Intraoperative 3-dimensional Projection of Blood Vessels on Body Surface Using an Augmented Reality System

“…We previously reported on the usefulness of intraoperative body surface evaluation using AR devices. 11 In addition, we developed a 3-point registration application for alignment between the entity and the holograms. 12 Preoperatively, 3 points were chosen to serve as references for alignment and marked on body surfaces near the surgical field (Fig.…”

Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review

“…(2017) validated their OST-assisted spine instrumentation approach in which neuronavigation images were streamed onto a Google Glass on 10 patients. Mitsuno et al (2017) tested their intraoperative body surface improvement approach on 8 patients, each with a different diagnosis. These clinical evaluations are very useful, but further studies will be required to establish clinical effectiveness and to demonstrate improved patient outcome.…”