A national training program for simulation educators and technicians: evaluation strategy and outcomes

Abstract

BackgroundSimulation-based education (SBE) has seen a dramatic uptake in health professions education over the last decade. SBE offers learning opportunities that are difficult to access by other methods. Competent faculty is seen as key to high quality SBE. In 2011, in response to a significant national healthcare issue – the need to enhance the quality and scale of SBE - a group of Australian universities was commissioned to develop a national training program - Australian Simulation Educator and Technician Training (AusSETT) Program. This paper reports the evaluation of this large-scale initiative.MethodsThe AusSETT Program adopted a train-the-trainer model, which offered up to three days of workshops and between four and eight hours of e-learning. The Program was offered across all professions in all states and territories. Three hundred and three participants attended workshops with 230 also completing e-learning modules. Topics included: foundational learning theory; orientation to diverse simulation modalities; briefing; and debriefing. A layered objectives-oriented evaluation strategy was adopted with multiple stakeholders (participants, external experts), methods of data collection (end of module evaluations, workshop observer reports and individual interviews) and at multiple data points (immediate and two months later). Descriptive statistics were used to analyse numerical data while textual data (written comments and transcripts of interviews) underwent content or thematic analysis.ResultsFor each module, between 45 and 254 participants completed evaluations. The content and educational methods were rated highly with items exceeding the pre-established standard. In written evaluations, participants identified strengths (e.g. high quality facilitation, breadth and depth of content) and areas for development (e.g. electronic portfolio, learning management system) of the Program. Interviews with participants suggested the Program had positively impacted their educational practices. Observers reported a high quality educational experience for participants with alignment of content and methods with perceived participant needs.ConclusionsThe AusSETT Program is a significant and enduring learning resource. The development of a national training program to support a competent simulation workforce is feasible. The Program objectives were largely met. Although there are limitations with the study design (e.g. self-report), there are strengths such as exploring the impact two months later. The evaluation of the Program informs the next phase of the national strategy for simulation educators and technicians with respect to content and processes, strengths and areas for development.Electronic supplementary materialThe online version of this article (doi:10.1186/s12909-016-0548-x) contains supplementary material, which is available to authorized users.

A Review: Embedding a Simulation Training Program in Labor and Delivery to Improve Healthcare Quality, Clinical Outcomes, and Patient Satisfaction

“…Nestel et al [37] published a qualitative research article that was developed because of an urgent "need to enhance the quality and scale of simulation-based education" in Australia.…”

The 2019 WACEM expert document on the framework for setting up a simulation centre

“…It is beneficial to have someone who is familiar with research methodologies which are applicable to simulation-based research, which needs to be evidence based and outcomes driven as well. [910121332]…”

“…Furthermore, after a scenario is developed, we encourage a trial run with our simulation technicians. [222632] Following this, refinements and modifications can be made accordingly. We also ask our learners to rate the level of realism, after every course, as relevant.…”

Using local clinical educators and shared resources to deliver simulation training activities across rural and remote South Australia and south‐west Victoria: A distributed collaborative model

“…Clinical educators were practicing registered nurses or midwives nominated by regional health services. Attainment of Certificate IV in Training and Assessment and completion of the National Health Education and Training in Simulation (NHET‐Sim) Program were further requirements for the role. Each clinical educator provided SBE within a radius of approximately 2 hours' drive from their base.…”