The Creation of an Objective Assessment Tool for Ultrasound-Guided Regional Anesthesia Using the Delphi Method

Cheung, Jeffrey J. H.; Chen, Ewen W.; Darani, Rosemin; McCartney, Colin J. L.; Dubrowski, Adam; Awad, Imad T.

doi:10.1097/aap.0b013e318246f63c

Cited by 92 publications

(56 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This study is the first to evaluate the reliability and validity of the assessment tool for UGRA proposed by Cheung et al 5 Reliability coefficients, such as ICC, are highly dependent on exact methodology used and population sampled. We found an ICC for this assessment tool of 0.44 using a fully crossed design with 6 assessors, using an ICC that took into account assessor agreement as well as correlation.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Evaluation of a Task-Specific Checklist and Global Rating Scale for Ultrasound-Guided Regional Anesthesia

Wong

Watson²,

Kluger

et al. 2014

Regional Anesthesia and Pain Medicine

View full text Add to dashboard Cite

Background and ObjectivesChecklists and global rating scales (GRSs) are used for assessment of anesthesia procedural skills. The purpose of this study was to evaluate the reliability and validity of a recently proposed assessment tool comprising a checklist and GRS specific for ultrasound-guided regional anesthesia.MethodsIn this prospective, fully crossed study, we videotaped 30 single-target nerve block procedures performed by anesthesia trainees. Following pilot assessment and observer training, videos were assessed in random order by 6 blinded, expert observers. Interrater reliability was evaluated with intraclass correlation coefficients (ICCs) based on a 2-way random-effects model that took into account both agreement and correlation between observer results. Construct validity and feasibility were also evaluated.ResultsThe ICC between assessors’ total scores was 0.44 (95% confidence interval, 0.27–0.62). All 6 observers scored “experienced trainees” higher than “inexperienced trainees” (median total score 76.7 vs 54.2, P = 0.01), supporting the test’s construct validity. The median time to assess the videos was 4 minutes 29 seconds.ConclusionsThis is the first study to evaluate the reliability and validity of a combined checklist and GRS for ultrasound-guided regional anesthesia using multiple observers and taking into account both absolute agreement and correlation in determining the ICC of 0.44 for interrater reliability. There was evidence to support construct validity.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Videos were edited on iMovie (version 8.0.6; Apple Inc) with ultrasound images displayed picturein-picture and synchronized with external video. 5 The GRS comprised 9 items on a 5-point text-anchored Likert scale and 1 dichotomous (pass/fail) item (Fig. 1).…”

Section: Observer Trainingmentioning

confidence: 99%

Evaluation of a Task-Specific Checklist and Global Rating Scale for Ultrasound-Guided Regional Anesthesia

Wong

Watson²,

Kluger

et al. 2014

Regional Anesthesia and Pain Medicine

View full text Add to dashboard Cite

show abstract

“…This method has been used to develop performance checklists with high content-related validity evidence. 17,18 One author (P.P. ), a critical care physician and ultrasound educator, created comprehensive step-by-step procedure checklists for CCUS modules based on existing literature and published guidelines.…”

Section: Methods For Validity Analysismentioning

confidence: 99%

“…17,18 The Delphi method is a consensus-based content generation method frequently used to develop guidelines, policy statements, and assessment tools. The modified Delphi method differs in that an initial structure is given to participants, from which feedback is generated and incorporated until consensus is reached.…”

Section: Methods For Validity Analysismentioning

confidence: 99%

Development and Validation of an Assessment Tool for Competency in Critical Care Ultrasound

Patrawalla

Eisen

Shiloh

et al. 2015

Journal of Graduate Medical Education

View full text Add to dashboard Cite

show abstract

“…Cheung et al have developed a checklist and global rating scale (GRS) specifically for all UGRA procedures. 39 This GRS could differentiate novices from experienced anesthesiologists when it was used for both on-site and remote summative assessments on a patient and simulation model. In contrast, the checklist could not discern the two groups on a simulation model remotely and differentiation was marginally significant with on-site scoring.…”

Section: B) Needling With Feedbackmentioning

confidence: 99%

The future of regional anesthesia education: lessons learned from the surgical specialty

Niazi

Peng

et al. 2016

Can J Anesth/J Can Anesth

View full text Add to dashboard Cite

Purpose Application of ultrasound in regional anesthesia has now become the standard of care and its use has shown to reduce complications. Nevertheless, gaining expertise in ultrasound-guided regional anesthesia requires the acquisition of new cognitive and technical skills. In addition, due to a reduction in resident working hours and enforcement of labour laws and directives across various states and countries, trainees perform and witness fewer procedures. Together, these issues create challenges in the teaching and learning of ultrasound-guided regional anesthesia in the time-based model of learning. Principal findings The challenges of teaching ultrasound-guided regional anesthesia are similar to those experienced by our surgical counterparts with the advent of minimally invasive surgery. In order to overcome these challenges, our surgical colleagues used theories of surgical skills training, simulation, and the concept of deliberate practice and feedback to shift the paradigm of learning from experience-based to competency-based learning. Conclusion In this narrative review, we describe the theory behind the evolution of surgical skills training. We also outline how we can apply these learning theories and simulation models to a competency-based curriculum for training in ultrasound-guided regional anesthesia.

show abstract

The Creation of an Objective Assessment Tool for Ultrasound-Guided Regional Anesthesia Using the Delphi Method

Abstract: Using the Delphi method, a checklist and GRS were developed. These tools can serve as an objective means of assessing progress in ultrasound technical skills acquisition.

Cited by 92 publications

References 17 publications

Evaluation of a Task-Specific Checklist and Global Rating Scale for Ultrasound-Guided Regional Anesthesia

Evaluation of a Task-Specific Checklist and Global Rating Scale for Ultrasound-Guided Regional Anesthesia

Development and Validation of an Assessment Tool for Competency in Critical Care Ultrasound

The future of regional anesthesia education: lessons learned from the surgical specialty

Contact Info

Product

Resources

About