A Virtual Reality Enhanced Cyber-Human Framework for Orthopedic Surgical Training

Gupta, Akhil; Cecil, J.; Pirela-Cruz, Miguel; Ramanathan, Parameswaran

doi:10.1109/jsyst.2019.2896061

Cited by 33 publications

(11 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Procedural discussions included details of the various steps, nursing duties, layouts of hospital rooms, presentation of medical equipment, and demonstrations of proper PPE usage, including equipping of gear in order, performing nasopharyngeal swab sampling, and removal of gear. Based on the suggestion and feedback from nurses and health personnel, information-centric process models (ICPM) based on the engineering Enterprise Modeling Langage (eEML) [25,26] were created of the target procedures; elided views of one of these models is shown in Fig. 1 for the swabbing task.…”

Section: Design Of the Vr Based Training Simulatormentioning

confidence: 99%

Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic

Cecil

Kauffman

Gupta

et al. 2021

2021 IEEE International Systems Conference (SysCon)

Self Cite

View full text Add to dashboard Cite

The COVID-19 pandemic has placed an overwhelming strain on our Nation's ability to treat patients; the number of patients who need to be tested continues to rise. With nurses also becoming infected, the number of trained professionals who can perform tasks such as testing of patients along with providing care involving hooking up patients to ventilators continues to decrease as well. There is a need to explore the adoption of virtual computer-based training mediums which will enable new nurses and others to be trained in safe and efficient procedures involving patients during this pandemic period. In this paper, the design of a VR-based simulator based on Human-Centered Computing (HCC) principles are discussed. The role of HCC factors such as affordance and cognitive load on the comprehension and scene understanding of nurses during training and the acquisition of knowledge of safety procedures and detailed steps (pertaining to nasal sample collection and use of ventilators on patients) has been studied with the involvement of nurse and nurse trainee participants. Adoption of a participatory design approach involving experts (nurses, doctors involved in covid-19 testing and treatment) has provided a foundational basis for the design of the training environments and assessment activities. Formal information-centric process models of the nasal swabbing procedures and ventilator hookup tasks were created using the engineering Enterprise Modeling Language (eEML). The preliminary results from the assessment activities indicate the positive impact of such HCC based 3D simulators in such training of first responders.

show abstract

Section: Design Of the Vr Based Training Simulatormentioning

confidence: 99%

Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic

Cecil

Kauffman

Gupta

et al. 2021

2021 IEEE International Systems Conference (SysCon)

Self Cite

View full text Add to dashboard Cite

show abstract

“…The first theme covers quality and validity of VR teaching simulations. Eight studies [18][19][20][21][22][23][24][25] covered this area of research (Table 1). The second theme discusses learning curves and changes in performance using these simulations.…”

Section: Thematic Analysismentioning

confidence: 99%

“…It was found to be a favourable alternative to traditional pedicle screw placement training. Gupta et al 22,25 developed a VR system for less invasive stabilization system plating surgery, which is used in the repair of fractured femurs. The system was enhanced two years later 25 and its validity was established.…”

Section: Quality and Validity Of Vr Teaching Simulationsmentioning

confidence: 99%

Virtual reality simulation in orthopaedic surgical training during periods of restricted clinical hours: a systematic review

Salaja¹,

Feeley²,

Feeley³

et al. 2021

J Surg Simul

View full text Add to dashboard Cite

Background: The public health response to the coronavirus pandemic has imposed limitations on orthopaedic surgeons' scheduled care practice, with a consequential reduction in training time for residents within the specialty. A potentially viable option for maintenance of operative competency is the use of virtual reality (VR) surgical simulation. This review looks at the effectiveness of VR as a pedagogical method of learning for orthopaedic trainees. Question: Can VR be a viable method of learning and skill retention for orthopaedic trainees during periods of reduced operative time? Methods: A systematic search using Google Scholar, EMBASE and PubMed was conducted in July 2020. Results: Following the PRISMA guidelines, the initial search revealed 779 studies. Thirty-five full-text articles were analysed by two reviewers and a final total of 29 articles were included in this review. The levels of evidence ranged from one to four with variable quality. A thematic analysis revealed three broad categories: quality and validity of VR teaching simulations studies (n = 8); learning curves and subject performance papers (n = 14); usefulness of VR simulators in orthopaedics reviews (n = 7). Conclusion: We demonstrated that VR has the capacity to help trainees maintain their technical skills, enhance their precision and retain rudimentary competency during this pandemic. Additional developments are necessary to ensure its safety as a training tool. Although there are limited orthopaedic-specific VR simulators, surgical trainees can benefit from VR-based training when paired with other forms of orthopaedic education, such as cadaveric laboratories and simulation suites.

show abstract

“…During recent years there has been a clear trend in the usage of augmented reality (AR), and virtual reality (VR) for pre-operative planning and intra-operative guidance [19]. VR visualization of the surgical environment has been proven highly efficient for the training of surgery skills [18]. Surgeons favorably accepted virtual reality headsets, mentioning a fast learning curve [21], [22], [23] and intuitive interface.…”

Section: Introductionmentioning

confidence: 99%

Autonomous Endoscope Robot Positioning Using Instrument Segmentation With Virtual Reality Visualization

Zinchenko

Song

2021

IEEE Access

View full text Add to dashboard Cite

This paper presents a method for endoscope's autonomous positioning by a robotic endoscope holder for minimally invasive surgery. The method improves human-robot cooperation in robot-assisted surgery by allowing the endoscope holder to acknowledge the surgeon's view projection and navigate the camera without manual control. The real-time prediction of next desired camera location is estimated using segmented instrument's tip locations from endoscope video and surgeon's attention focus given by tracked virtual reality headset. To tackle the issue of real-time surgical instrument segmentation for more precise instrument tip localization, we propose the YOLOv3 and ResNet Combined Neural Network. The method showed an 86.6% IoU across MICCAI'17 Endovis datasets with 30 frames per second processing speed. The proposed pipeline was implemented in ROS on Ubuntu with visualization running under Windows operating system in Unity3D. The simulation demonstrates the robotic arm, endoscope, and surgical environment visualized in 3D in the virtual reality headset to provide a stable view of the endoscope and improve the surgeon's perception of the operating environment.INDEX TERMS autonomous robot control, artificial neural network, minimally invasive surgery, object segmentation, human-robot cooperation.

show abstract

A Virtual Reality Enhanced Cyber-Human Framework for Orthopedic Surgical Training

Cited by 33 publications

References 55 publications

Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic

Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic

Virtual reality simulation in orthopaedic surgical training during periods of restricted clinical hours: a systematic review

Autonomous Endoscope Robot Positioning Using Instrument Segmentation With Virtual Reality Visualization

Contact Info

Product

Resources

About