Background/contextThere is growing evidence that simulation-based training (SBT) is effective as an educational intervention.1 However, most evidence relates to learner satisfaction and knowledge acquisition, which are the lower Kirkpatrick levels of impact. Although there is evidence of translation of learning to the workplace,2 there is still a relative lack of evidence of whether patient outcome is improved. This study aimed to determine whether there is an association between exposure to SBT, self-assessed performance in managing an acute event, and perceived patient outcome.MethodologyA retrospective, cross-sectional e-survey, constructed as three Likert-type scales, was sent to trainees working in three hospitals in the UK, to determine whether they had been involved in the management of specified critical events and whether management of these events and patient outcomes were attributed to their exposure to SBT. The respective Likert scales measured:Performance in managing the acute eventSelf-assessed effect of SBT on performancePatient outcome after the acute eventNegative opinions were scored 1–2, positive 4–5 and neutral 3. Amalgamated scale results were treated as continuous data, from which means and confidence intervals were calculated.3
Results/outcomesOne hundred trainees of all grades from 8 different medical specialties completed the questionnaire. Of the 92 who had been exposed to SBT, 39 had done so within the last 3 months, 18 in 3–6 months, 26 in 6–12 months, and 11 in > 12 months. Results are shown in Table 1.Table 1. Self-assessed performance in managing an acute patient event, effect of SBT on management, and perceived patient outcomes after exposure to SBT at various time periods. Scores greater than 3 indicate a positive opinion. (To be presented on poster).Conclusions and recommendationsAlthough there was a tendency to positively associate performance in managing an acute patient event, and good patient outcomes, with recent exposure to SBT, there is no significant difference in the effect of SBT at any time period less than 24 months (p > 0.05).ReferencesLorello G, Cook D, Johnson R, Brydges R. Simulation-based training in anaesthesiology: a systematic review and meta-analysis. BJA 2014;112(2):231–45. Boet S, Bould MD, Fung L, et al. Transfer of learning and patient outcome in simulated crisis resource management: a systematic review. CJA 2014;61: 571–582Carifio J, Perla R. Resolving the 50-year debate around using and misusing Likert scales. Med Educ. 2008;42:1150–52