Basic critical care echocardiography: How many studies equate to competence? A pilot study using high fidelity echocardiography simulation

Abstract

Background: Assessment of competence in basic critical care echocardiography is complex. Competence relies on not only imaging accuracy but also interpretation and appropriate management decisions. The experience to achieve these skills, real-time, is likely more than required for imaging accuracy alone. We aimed to assess the feasibility of using simulation to assess number of studies required to attain competence in basic critical care echocardiography. Methods: This is a prospective pilot study recruiting trainees at various degrees of experience in basic critical care echocardiography using experts as reference standard. We used high fidelity simulation to assess speed and accuracy using total time taken, total position difference and total angle difference across the basic acoustic windows. Interpretation and clinical application skills were assessed using a clinical scenario. 'Cut-off' values for number of studies required for competence were estimated. Results: Twenty-seven trainees and eight experts were included. The subcostal view was achieved quickest by trainees (median 23 s, IQR 19-37). Eighty-seven percent of trainees did not achieve accuracy across all views; 81% achieved accuracy with the parasternal long axis and the least accurate was the parasternal short axis (44% of trainees). Fewer studies were required to be considered competent with imaging acquisition compared with competence in correct interpretation and integration (15 vs. 40 vs. 50, respectively). Discussion: The use of echocardiography simulation to determine competence in basic critical care echocardiography is feasible. Competence in image acquisition appears to be achieved with less experience than correct interpretation and correct management decisions. Further studies are required.

Test of simulator‐based assessment of psychomotor skill in transthoracic echo

“…Our previous studies demonstrated the relationship of deviation angle to competence level by comparing the scores of experts vs. trained novices and of untrained vs. trained novices (Sheehan et al, 2013;Skinner et al, 2016). Others have also reported that simulator-based measurement of psychomotor skill reflects provider experience (Bowcock et al, 2017).…”

Building focused cardiac ultrasound capacity in a lower middle-income country: A single centre study to assess training impact

“…Post-workshop supervised practice was significantly hampered by scheduling difficulties between novices and trainers, all of whom had clinical care responsibilities. Nevertheless, the ideal number of practice scans necessary to achieve competency in FoCUS is still a matter of contention [ 22 ]. While the 2018 EACVI consensus document recommends a minimum of 50 practice scans [ 9 ], the FATE curriculum that we followed recommends 20, ten of which must be supervised.…”

Thoracic ultrasound competence for ultrasound-guided pleural procedures

“…This has resulted in the development of alternative methods such as objective structured assessments, including the use of simulators. Despite the development of such assessments, they have yet to be widely adopted [52][53][54].…”

“…High-fidelity simulators have been proven to be valid and reliable in a number of examination settings, including ultrasound and in particular, a validated TUS simulator test has been recently developed. The final assessment of "does" is likely best measured using either portfolios with ongoing summative and formative assessments or logbooks with supervision; however, minimum numbers of procedures or scans not only remain undefined but may not be a valuable metric given the uncertainty around the validity and the variations in learning curves [31,33,39,41,43,54,58].…”