Current and Future Applications of Virtual, Augmented, and Mixed Reality in Cardiothoracic Surgery

Augmented reality-assisted localization of solitary pulmonary nodules for precise sublobar lung resection: a preliminary study using an animal model

“…Digitization, minimally invasion, and intelligent operation are essential developments in modern surgical technology. In recent years, many innovative studies and clinical applications involving augmented reality (AR) technology have emerged in biomedicine and surgery, which are regarded as the cross-disciplinary integration of medicine and industry (9)(10)(11). AR is an innovative technology that superimpose a virtual scene into the real environment by fusing images, videos, or computergenerated models with patients during surgical operations.…”

Virtual reality and artificial intelligence for 3-dimensional planning of lung segmentectomies

“…In accordance to the reported data from the literature on VR applications, in this study we have demonstrated that our PulmoVR tool enables immersive interactive image manipulation, realistic in-depth perception, and immersive visualization of complex relationships of anatomic structures (eg, vascular, bronchial, tumor margins, and segmental borders) that can be applied by surgeons preoperatively (without the need to consult radiologists or imaging technicians) to gain a better and more realistic insight into a patient's specific anatomy. 8,10 Additionally, we have showed that PulmoVR tool is easy and ready to use after only a single demonstration and tutorial of 15 minutes as was concluded from the questioners filled out by the participating surgeons. The software can be installed on every computer or laptop with sufficient graphical and processing power and the off-the-shelf VR head mounted displays are widely available.…”

“… 7 , 8 , 9 A VR platform has more features and functions than existing 2D or 3D planning software, including immersive and interactive manipulation, realistic in-depth perception, and visualization of complex relationships of anatomic structures that are ready at hand and can be applied by surgeons to gain a more realistic insight into a patient's anatomy. 8 , 10 Moreover, automated imaging algorithms could potentially create a more efficient planning by enabling automatic visualization of anatomic structures of interest. 11 , 12 By developing an artificial intelligence (AI)-based and immersive 3D-VR platform as a supplementary preoperative planning tool to traditional CT imaging, a novelty can be added to the thoracic surgeon's armamentarium.…”

The Impact of Biomedical Engineering on the Development of Minimally Invasive Cardio-Thoracic Surgery

“…However, the surgeon must also assess imaging from a variety of sources such as echoscopy, CT scan, fluoroscopy, 3D adjustments, and real-time feedback in just a couple of seconds. The preparation or execution by means of a Microsoft HoloLense allows for the projection of the most relevant information, evenly matched with augmented or virtual reality components without searching, scrolling, or discussion [16,17]. Indeed, the work process, usability, appropriate skill level of the surgeon and human engineering factor determine whether the addition of these technologies indeed contributes to the efficacy and safety of a procedure and results in an additional benefit for the patient.…”