Reliability and validity of procedure‐based assessments in otolaryngology training

Awad, Zaid; Hayden, L. B.; Robson, Andrew; Muthuswamy, Keerthini; Tolley, Neil

doi:10.1002/lary.24983

Cited by 11 publications

(38 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The assessment was based on direct observation with no blinding of raters. Using anonymized video recordings would eliminate this bias; however, direct supervision and feedback is meant to enrich the learning opportunity and simulate training and assessment in the operative setting …”

Section: Discussionmentioning

confidence: 99%

“…Using anonymized video recordings would eliminate this bias; however, direct supervision and feedback is meant to enrich the learning opportunity and simulate training and assessment in the operative setting. 20 Finally, nontechnical skills such as judgment, which are an important part of competency assessment, have not yet been assessed during CTB simulation because the study was limited to the previously validated assessment tool, which focuses on technical skills.…”

Section: Limitationsmentioning

confidence: 99%

See 1 more Smart Citation

Construct validity of cadaveric temporal bones for training and assessment in mastoidectomy

Awad

Tornari²,

Ahmed

et al. 2015

The Laryngoscope

Self Cite

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Limitationsmentioning

confidence: 99%

Construct validity of cadaveric temporal bones for training and assessment in mastoidectomy

Awad

Tornari²,

Ahmed

et al. 2015

The Laryngoscope

Self Cite

View full text Add to dashboard Cite

show abstract

“…10 Internal consistency serves to confirm that the tool tests for the concept of interest, while intrarater consistency and interrater consistency test respectively the outcomes of having only 1 versus many raters use the tool, to determine the reproducibility of the results. 22 Each of these criteria was ranked as high, moderate, or low. Internal consistency was overall high, with 15 tools ranking high, 3 ranking moderate, and none scoring low.…”

Section: Resultsmentioning

confidence: 99%

Objective Assessment of Technical Skills in Otorhinolaryngology–Head and Neck Surgery Residents: A Systematic Review

Mercier

Chagnon-Monarque

Lavigne

et al. 2017

Otolaryngol.--head neck surg.

View full text Add to dashboard Cite

Objectives The primary goal is the indexation of validated methods used to assess surgical competency in otorhinolaryngology-head and neck surgery (ORL-HNS) residents. Secondary goals include assessment of the reliability and validity of these tools, as well as the documentation of specific procedures in ORL-HNS involved. Data Sources MEDBASE, OVID, Medline, CINAHL, and EBM, as well as the printed references, available through the Université de Montréal library. Review Methods The PRISMA method was used to review digital and printed databases. Publications were reviewed by 2 independent reviewers, and selected articles were fully analyzed to classify evaluation methods and categorize them by procedure and subspecialty of ORL-HNS involved. Reliability and validity were assessed and scored for each assessment tool. Results Through the review of 30 studies, 5 evaluation methods were described and validated to assess the surgical competency of ORL-HNS residents. The evaluation method most often described was the combined Global Rating Scale and Task-Specific Checklist tool. Reliability and validity for this tool were overall high; however, considerable data were unavailable. Eleven distinctive surgical procedures were studied, encompassing many subspecialties of ORL-HNS: facial plastics, general ear-nose-throat, laryngology, otology, pediatrics, and rhinology. Conclusions Although assessment tools have been developed for an array of surgical procedures, involving most ORL-HNS subspecialties, the use of combined checklists has been repeatedly validated in the literature and shown to be easily applicable in practice. It has been applied to many ORL-HNS procedures but not in oncologic surgery to date.

show abstract

“…Given the importance of mastering clinical examinations at earlier stages (CT1‐ST3), trainees should be encouraged to attain CEX competency as early as possible. However, given the limited ability of the CEX to distinguish between higher level trainees, the latter should focus on other tools which can assess trainees at all levels . CEX outcomes have the potential to be used in a summative capacity to aid selection for higher training.…”

Section: Resultsmentioning

confidence: 99%

Utilisation, Reliability and Validity of Clinical Evaluation Exercise in Otolaryngology Training

Awad

Hayden

Muthuswamy

et al. 2015

Clinical Otolaryngology

View full text Add to dashboard Cite

show abstract

Reliability and validity of procedure‐based assessments in otolaryngology training

Abstract: NA.

Cited by 11 publications

References 16 publications

Construct validity of cadaveric temporal bones for training and assessment in mastoidectomy

Construct validity of cadaveric temporal bones for training and assessment in mastoidectomy

Objective Assessment of Technical Skills in Otorhinolaryngology–Head and Neck Surgery Residents: A Systematic Review

Utilisation, Reliability and Validity of Clinical Evaluation Exercise in Otolaryngology Training

Contact Info

Product

Resources

About