Multi-institutional virtual mock oral examinations for general surgery residents in the era of COVID-19

Huang, Ivy A.; Ling, Yang; Wagner, Justin P.; Quach, Chi; Donahue, Timothy R.; Tillou, Areti; Chen, Formosa; Wu, James X.

doi:10.1016/j.amjsurg.2020.11.002

Cited by 4 publications

(2 citation statements)

References 6 publications

(5 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Two multi-institutional studies focused on vascular and cardiothoracic surgery trainees, for example, found the virtual mock oral platform to be both feasible and useful for participants [ 17 , 18 ]. Similar pilot experiences have been published in the general surgery literature indicating that both faculty and trainee participants are satisfied with the experience and seek standardization of the process moving forward [ 19 , 20 ]. In these pilot studies, trainees were primarily evaluated with pass–fail case rubrics and written feedback.…”

Section: Introductionmentioning

confidence: 64%

The Advanced Certifying Exam Simulation-Pro assessment instrument: evaluating surgical trainee examsmanship in virtual oral exams

et al. 2023

View full text Add to dashboard Cite

Purpose In response to the COVID-19 pandemic, many educational activities in general surgery residency have shifted to a virtual environment, including the American Board of Surgery (ABS) Certifying Exam. Virtual exams may become the new standard. In response, we developed an evaluation instrument, the ACES-Pro, to assess surgical trainee performance with a focus on examsmanship in virtual oral board examinations. The purpose of this study was two-fold: (1) to assess the utility and validity of the evaluation instrument, and (2) to characterize the unique components of strong examsmanship in the virtual setting, which has distinct challenges when compared to in-person examsmanship. Methods We developed a 15-question evaluation instrument, the ACES-Pro, to assess oral board performance in the virtual environment. Nine attending surgeons viewed four pre-recorded oral board exam scenarios and scored examinees using this instrument. Evaluations were compared to assess for inter-rater reliability. Faculty were also surveyed about their experience using the instrument. Results Pilot evaluators found the ACES-Pro instrument easy to use and felt it appropriately captured key professionalism metrics of oral board exam performance. We found acceptable inter-rater reliability in the domains of verbal communication, non-verbal communication, and effective use of technology (Guttmann’s lambda-2 were 0.796, 0.916, and 0.739, respectively). Conclusions The ACES-Pro instrument is an assessment with evidence for validity as understood by Kane’s framework to evaluate multiple examsmanship domains in the virtual exam setting. Examinees must consider best practices for virtual examsmanship to perform well in this environment. Supplementary Information The online version contains supplementary material available at 10.1007/s44186-023-00107-7.

show abstract

Section: Introductionmentioning

confidence: 64%

The Advanced Certifying Exam Simulation-Pro assessment instrument: evaluating surgical trainee examsmanship in virtual oral exams

et al. 2023

View full text Add to dashboard Cite

show abstract

“…The quizzes were intended to ensure the continuity of the learning process, assure students about their achievement, and minimise/alleviate their stress from high-stakes end-of-course exams during the pandemic. 15 …”

Section: Methodsmentioning

confidence: 99%

Web-based and paper-based examinations: Lessons learnt during the COVID-19 pandemic lockdown

Saleh

Alamro

Wadi

2022

Journal of Taibah University Medical Sciences

View full text Add to dashboard Cite

From the Editor – in – Chief: Top papers from the Association for Surgical Education

Chen¹

2021

The American Journal of Surgery

View full text Add to dashboard Cite

Multi-institutional virtual mock oral examinations for general surgery residents in the era of COVID-19

Cited by 4 publications

References 6 publications

The Advanced Certifying Exam Simulation-Pro assessment instrument: evaluating surgical trainee examsmanship in virtual oral exams

The Advanced Certifying Exam Simulation-Pro assessment instrument: evaluating surgical trainee examsmanship in virtual oral exams

Web-based and paper-based examinations: Lessons learnt during the COVID-19 pandemic lockdown

From the Editor – in – Chief: Top papers from the Association for Surgical Education

Contact Info

Product

Resources

About