Measuring participants’ immersion in healthcare simulation: the development of an instrument

Abstract

BackgroundImmersion is important for simulation-based education; however, questionnaire-based instruments to measure immersion have some limitations. The aim of the present work is to develop a new instrument to measure immersion among participants in healthcare simulation scenarios.MethodsThe instrument was developed in four phases: trigger identification, content validity scores, inter-rater reliability analysis and comparison with an existing immersion measure instrument. A modified Delphi process was used to develop the instrument and to establish validity and reliability. The expert panel consisted of 10 researchers. All the researchers in the team had previous experience of simulation in the health and/or fire and rescue services as researchers and/or educators and simulation designers. To identify triggers, the panel members independently screened video recordings from simulation scenarios. Here, a trigger is an event in a simulation that is considered a sign of reduced or enhanced immersion among simulation participants.ResultsThe result consists of the Immersion Score Rating Instrument (ISRI). It contains 10 triggers, of which seven indicate reduced and three enhanced immersion. When using ISRI, a rater identifies trigger occurrences and assigns them strength between 1 and 3. The content validity analysis shows that all the 10 triggers meet an acceptable content validity index for items (I-CVI) standard. The inter-rater reliability (IRR) among raters was assessed using a two-way mixed, consistency, average-measures intra-class correlation (ICC). The ICC for the difference between weighted positive and negative triggers was 0.92, which indicates that the raters are in agreement. Comparison with results from an immersion questionnaire mirrors the ISRI results.ConclusionsIn conclusion, we present a novel and non-intrusive instrument for identifying and rating the level of immersion among participants in healthcare simulation scenarios.Electronic supplementary materialThe online version of this article (doi:10.1186/s41077-016-0018-x) contains supplementary material, which is available to authorized users.

How does moulage contribute to medical students’ perceived engagement in simulation? A mixed-methods pilot study

“…This highlights the individual part of being able to suspend disbelief to participate actively in the simulation. This concept of engagement is echoed by many authors [4][5][6], yet there has been little discussion on what engagement means in the context of simulation. Indeed, Padgett et al raise this in a critical narrative review of the definition of engagement in simulation, agreeing that the term engagement is used loosely and without clear definition [7].…”

Simulating a self-inflicted facial gunshot wound with moulage to improve perceived realism, immersion, and learning in simulation-based airway management training

“…Future work should use objective measures in place of, or in conjunction with, subjective measures to evaluate their moulage, 9 such as the recently developed Immersion Score Rating Instrument. 17 However, objective measures require substantially more resources, such as video recording equipment and additional personnel.…”

The Effects of Integrated IT Support on the Prehospital Stroke Process: Results from a Realistic Experiment

“…The simulation platform is a part of a research project (SAREK) [36] with the aim to contextualise the prehospital work process using a serious gameinspired approach to accomplish better simulation [37]. The platform has been tested for immersion [38] and has been found superior to traditional simulation where some phases in an ambulance mission are excluded and with lower equipment and environmental fidelity. Using a contextualised simulation, platform was found to affect immersion positively and thus contributes to an improved simulation experience [28].…”