A new assessment methodology for virtual reality surgical simulators

Bayona, Sof ía; Fernández-Arroyo, José Manuel Fernández; Bayona, Pilar; Pastor, Luis

doi:10.1002/cav.268

Cited by 4 publications

(4 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As a basis for the evaluation of VR surgical simulators, we propose the following methodology. More detail and a practical application can be found in [12].…”

Section: Methodology For the Evaluation Of Vr Simulatorsmentioning

confidence: 99%

See 1 more Smart Citation

A Global Approach to the Design and Evaluation of Virtual Reality Medical Simulators

Bayona

Fernández-Arroyo

Bayona³

et al. 2011

ASME 2011 World Conference on Innovative Virtual Reality

Self Cite

View full text Add to dashboard Cite

VR Simulators are a powerful alternative to traditional educational techniques in many domains; and in particular, in surgery. Although they offer new possibilities for learning, training and assessment, they still found difficult to be accepted and integrated into hospitals. In this paper, we explain what we consider the key issues to create successful VR simulators, and we present two methodologies: the guidelines for the simulator design and the evaluation of their validity. Research on VR surgical simulators should be interdisciplinary. It involves medicine, educational psychology, computer science, and engineering. Optimal interdisciplinary communication is difficult, and most projects in surgical simulation are strongly influenced by the engineering perspective, with little or no contributions from the others. This unbalance often leads to a premature end of the project or to simulators which are less practical for surgeons. A design methodology should be used as a guide in the process of creating VR simulators. A thorough description of the problem, the simulator’s role, and an exhaustive task analysis will lead to the identification of the requirements. For the technical implementation, decisions will be taken related to the hardware interface and the interaction that users will have with the virtual world; which will determine collision detection and response algorithms, and the behaviour of the 3D models. In addition to the technical testing, it is necessary to prove the validity of the simulator and design procedures to measure the user performance. We explain a methodology to evaluate the validity (face, content, and criterion-related validity), reliability and transfer of skills from a VR simulator to the real environment in a structured and rigorous way. Following this methodology, an evaluation experiment involving 19 orthopaedic doctors using a VR arthroscopy simulator was carried out. Results prove face and content validities, and inform about the factors and measures that are considered important for arthroscopic surgery. In order to consolidate the research results, we encourage the establishment of an intersectorial consortium with agents from the academic, healthcare and industrial sectors to ensure the long-term sustainability of research lines, additional funding, and to guarantee that simulators, once validated, can be widely available in hospitals. This paper presents a global approach including relevant guidelines and methodologies for designing and evaluating VR simulators. It can provide a solid structure for other researchers when facing those processes and contribute to the successful integration of VR simulators within the educational curriculum.

show abstract

“…As a basis for the evaluation of VR surgical simulators, we propose the following methodology. More detail and a practical application can be found in [12].…”

Section: Methodology For the Evaluation Of Vr Simulatorsmentioning

confidence: 99%

“…A thorough classification of different studies according to different criteria can be found in [12]. Here, we summarize them in Table 1.…”

Section: Methodology For the Evaluation Of Vr Simulatorsmentioning

confidence: 99%

A Global Approach to the Design and Evaluation of Virtual Reality Medical Simulators

Bayona

Fernández-Arroyo

Bayona³

et al. 2011

ASME 2011 World Conference on Innovative Virtual Reality

Self Cite

View full text Add to dashboard Cite

show abstract

“…Following on from concern over the adverse outcomes associated with the learning curve, and in the footsteps of the aviation industry, surgical training is increasingly embracing technological advances for the education and assessment of trainees. Various surgical virtual reality simulators are now available, which aim to teach and evaluate trainees performing both general and minimally invasive standardized surgical procedures [26]. Haptic technology assessing manual dexterity has been shown to correlate with the OSATS global rating score by Datta et al [27].…”

Section: Implications For Future Practicementioning

confidence: 99%

Validation of a Global Rating Scale for Shoulder Arthroscopy: A Pilot Study

Hoyle

Whelton

Umaar³

et al. 2012

Shoulder & Elbow

View full text Add to dashboard Cite

Background Reliable, valid, feasible and objective assessment is desirable in all aspects of medical training to allow monitoring of progress and to ensure high standards. At present, no assessment model for shoulder arthroscopy exists that indisputably meets these criteria. The global rating scale (GRS) has been validated as a measure of technical performance in various surgical procedures. We have developed and aim to validate a GRS for shoulder arthroscopy (GRSSA). Materials and methods Using the GRSSA, 13 shoulder surgeons, rated 10 videos of diagnostic shoulder arthroscopy showing different levels of proficiency. Assessments were performed remotely using an online system developed for the study; assessors were blinded to the experience of the surgeon who was performing the arthroscopy. Construct validity was assessed via Cronbach's α and inter‐rater reliability was assessed via two‐way analysis of variance (ANOVA). Results The results suggest good construct validity (high internal consistency of GRSSA categories: Cronbach's α = 0.89 to 0.96). Two‐way ANOVA demonstrated a good discriminatory ability of the GRSSA but variability between raters (p = 0.0002 to 0.01), suggesting a current lack of inter‐rater reliability. Discussion The GRSSA appears to be a useful tool for the assessment of diagnostic arthroscopic skills and, using our online system, the assessor can be remote to the surgeon who is performing the procedure.

show abstract

“…Second, specific surgical procedures are too complicated to simulate, given the software and hardware specification of early simulators. Recently, a commercial arthroscopy simulator called insightArthro VR was developed by GMV (Madrid, Spain) . It has been widely used in European countries and is considered to be an efficient tool for arthroscopic surgery training.…”

Section: Introductionmentioning

confidence: 99%

vKASS: a surgical procedure simulation system for arthroscopic anterior cruciate ligament reconstruction

Wang

Xiong

et al. 2012

Computer Animation & Virtual

View full text Add to dashboard Cite

Arthroscopic surgeries, which are widely used for anterior cruciate ligament (ACL) reconstruction, not only require advanced hand–eye coordination but also involve complicated surgical procedure, necessitating simulation‐based training for surgeons. This paper describes a surgical procedure simulation system for the training of arthroscopic ACL reconstruction. Different from existing simulation‐based training systems for basic surgical skills, this system provides a complete simulation for the entire procedure of arthroscopic ACL reconstruction, involving operations such as puncturing, probing, incision, and drilling. In this system, we employ a linear elastic finite element method and position‐based dynamics for deformable modeling. Simplified vertex duplicating method and an implementation of real‐time Boolean operations are proposed for the topological change of tissue models involved in the incision simulation and tunnel construction. Two specially designed force feedback models are introduced for the haptic rendering of probing and drilling operations. By using these fast and stable simulation methods, this system is able to provide real‐time realistic graphical and haptic feedback to the user, making it efficient and practical for training purpose. Feedback from the surgeon trainees shows that this system is very effective in training not only for basic surgical skills but also for the complex surgical procedure. Copyright © 2012 John Wiley & Sons, Ltd.

show abstract

A new assessment methodology for virtual reality surgical simulators

Cited by 4 publications

References 17 publications

A Global Approach to the Design and Evaluation of Virtual Reality Medical Simulators

A Global Approach to the Design and Evaluation of Virtual Reality Medical Simulators

Validation of a Global Rating Scale for Shoulder Arthroscopy: A Pilot Study

vKASS: a surgical procedure simulation system for arthroscopic anterior cruciate ligament reconstruction

Contact Info

Product

Resources

About