Development of an augmented reality simulator for a robotic system used in single incision laparoscopic surgery

Vaida, Călin; Rus, Gabriela; Gherman, Bogdan; Pusca, Alexandru; Tucan, Paul; Ulinici, Ionut; Pîslă, Doina

doi:10.59277/rjts-am.2023.1.01

Cited by 5 publications

(2 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In robotic-assisted surgery, Hololens 2 was used to assist in surgical navigation based on holographic markers [ 27 ] to explore the possibility of replacing real monitors with virtual ones, on which images from the endoscopic camera are displayed [ 28 ]. Another application of Hololens 2 was to create simulators through which the surgical robots can be tested in safe conditions in the prototype phase [ 29 ].…”

Section: Methodsmentioning

confidence: 99%

Artificial Intelligence-Based Hazard Detection in Robotic-Assisted Single-Incision Oncologic Surgery

Rus

Andraș

Vaida

et al. 2023

Cancers

View full text Add to dashboard Cite

The problem: Single-incision surgery is a complex procedure in which any additional information automatically collected from the operating field can be of significance. While the use of robotic devices has greatly improved surgical outcomes, there are still many unresolved issues. One of the major surgical complications, with higher occurrence in cancer patients, is intraoperative hemorrhages, which if detected early, can be more efficiently controlled. Aim: This paper proposes a hazard detection system which incorporates the advantages of both Artificial Intelligence (AI) and Augmented Reality (AR) agents, capable of identifying, in real-time, intraoperative bleedings, which are subsequently displayed on a Hololens 2 device. Methods: The authors explored the different techniques for real-time processing and determined, based on a critical analysis, that YOLOv5 is one of the most promising solutions. An innovative, real-time, bleeding detection system, developed using the YOLOv5 algorithm and the Hololens 2 device, was evaluated on different surgical procedures and tested in multiple configurations to obtain the optimal prediction time and accuracy. Results: The detection system was able to identify the bleeding occurrence in multiple surgical procedures with a high rate of accuracy. Once detected, the area of interest was marked with a bounding box and displayed on the Hololens 2 device. During the tests, the system was able to differentiate between bleeding occurrence and intraoperative irrigation; thus, reducing the risk of false-negative and false-positive results. Conclusion: The current level of AI and AR technologies enables the development of real-time hazard detection systems as efficient assistance tools for surgeons, especially in high-risk interventions.

show abstract

Section: Methodsmentioning

confidence: 99%

Artificial Intelligence-Based Hazard Detection in Robotic-Assisted Single-Incision Oncologic Surgery

Rus

Andraș

Vaida

et al. 2023

Cancers

View full text Add to dashboard Cite

show abstract

“…The system is equipped with an augmented reality module, which is utilized both in the operation and preplanning. This module, based on the AI agent segmentation algorithm described in [35,39]) allows the medical professional to simulate the entire procedure and verify if the robotic system can reach the target organ or specific points within the organ. The entire process is supervised by a master computer that facilitates communication with visualization tools, input devices, haptic devices, and patient monitoring devices.…”

Section: Design and Functionality Of The Para-silsrob Robotic Structurementioning

confidence: 99%

Safety Issues in the Development of an Innovative Medical Parallel Robot Used in Renal Single-Incision Laparoscopic Surgery

Pîslă

Crişan

Gherman

et al. 2023

JCM

Self Cite

View full text Add to dashboard Cite

Robotic-assisted single-incision laparoscopic surgery (SILS) is becoming an increasingly widespread field worldwide due to the benefits it brings to both the patient and the surgeon. The goal of this study is to develop a secure robotic solution for SILS, focusing specifically on urology, by identifying and addressing various safety concerns from an early design stage. Starting with the medical tasks and protocols, the technical specifications of the robotic system as well as potential; hazards have been identified. By employing competitive engineering design methods such as Analytic Hierarchy Process (AHP), Risk assessment, and Failure Mode and Effects Analysis (FMEA), a safe design solution is proposed. A set of experiments is conducted to validate the proposed concept, and the results strongly support the development of the experimental model. The Finite Element Analysis (FEA) method is applied to validate the mechanical architecture within a set of simulations, demonstrating the compliance of the robotic system with the proposed technical specifications and its capability to safely perform SILS procedures.

show abstract

From art to evolution: Why functional morphology of birds matters

Zinoviev

2023

Proceedings ZIN

View full text Add to dashboard Cite

Here we discuss the main stages in the study of the morphology of the avian hind limbs as an example of the historical development of morphological studies in biology: from illustrations at the level of a work of art, through the collection of anatomical material and its functional interpretation to the reconstruction of hypothetical and real forms. We provide a synopsis of original studies, describing the stages in the evolution of jacanas and trogons, as well as the key locomotor adaptation of passerine birds. Reconstructions of the soft tissues and ligaments of the hind limbs of the Hesperornis, moa, and Haast’s eagle make it possible to judge the peculiarities of locomotion in extinct species.

show abstract

Development of an augmented reality simulator for a robotic system used in single incision laparoscopic surgery

Cited by 5 publications

References 23 publications

Artificial Intelligence-Based Hazard Detection in Robotic-Assisted Single-Incision Oncologic Surgery

Artificial Intelligence-Based Hazard Detection in Robotic-Assisted Single-Incision Oncologic Surgery

Safety Issues in the Development of an Innovative Medical Parallel Robot Used in Renal Single-Incision Laparoscopic Surgery

From art to evolution: Why functional morphology of birds matters

Contact Info

Product

Resources

About