Effects of a Resident's Reputation on Laparoscopic Skills Assessment

Tannenbaum, Evan; Walker, Melissa; Sullivan, Heather; Huszti, Ella; Farrugia, Michele; Sobel, Mara

doi:10.1097/aog.0000000000004426

Cited by 5 publications

(9 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…29 Similarly, more time interacting with faculty and colleagues may allow residents to make a distinct impression that subsequently influences assessments. 30,31 Another explanation may be a culture of presenteeism that rewards attendance and prioritises work over personal needs. 32,33 Individual factors, such as resilience, health, lifestyle, social supports, personal hardship or financial stress, may have combined influences on attendance and performance.…”

Section: Discussionmentioning

confidence: 99%

“…Time spent on call together may help residents form social connections and institutional inclusion that may reduce burnout and improve performance 29 . Similarly, more time interacting with faculty and colleagues may allow residents to make a distinct impression that subsequently influences assessments 30,31 . Another explanation may be a culture of presenteeism that rewards attendance and prioritises work over personal needs 32,33 .…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

On‐call absences and academic recognition: A retrospective cohort analysis

2023

View full text Add to dashboard Cite

BackgroundResident call schedules require careful planning and are vulnerable to unanticipated absences from unpredictable factors. We tested whether unplanned absences from resident call schedules were associated with the likelihood of subsequent academic recognition.MethodsWe examined unplanned absences from call shifts for internal medicine residents at the University of Toronto from 2014 to 2022 (8 years). We identified institutional awards granted at the end of the academic year as an indicator of academic recognition. We defined the resident‐year as the unit‐of‐analysis that started in July and ended in June of the subsequent year. Secondary analyses examined the association between unplanned absences and the likelihood of academic recognition in later years.ResultsWe identified 1668 resident‐years of training in internal medicine. In total, 579 (35%) had an unplanned absence, and the remaining 1089 (65%) had no unplanned absence. Baseline characteristics were similar between the two groups of residents. In total, 301 awards were received for academic recognition. The likelihood of receiving an award at the end of the year was 31% lower for residents who had any unplanned absence compared with those who had no absence (adjusted odds ratio = 0.69, 95% confidence interval 0.51–0.93, p = 0.015). The likelihood of receiving an award was further decreased for residents with multiple unplanned absences compared with those with none (odds ratio 0.54, 95% confidence interval 0.33–0.83, p = 0.008). An absence during the first year of residency was not significantly associated with the likelihood of academic recognition in later years of training (odds ratio 0.62, 95% confidence interval 0.36–1.04, p = 0.081).ConclusionsThe results of this analysis suggest unplanned absences from scheduled call shifts may be associated with a decreased likelihood of academic recognition for internal medicine residents. This association could reflect countless confounders or the prevailing culture of medicine.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

On‐call absences and academic recognition: A retrospective cohort analysis

2023

View full text Add to dashboard Cite

show abstract

“…outcomes and other performance assessment tools, considered the gold standard (concurrent validity). [22][23][24]27,28,30,35,36,[38][39][40]57,58,[61][62][63][64][65][66][67][68][69][70][71][72][73][74][75][76][77] Nine out of 13 (69.2%) procedure-specific tool studies [31][32][33][42][43][44][46][47][48][49][50]60 showed construct or concurrent validity.…”

Section: Ta B L Ementioning

confidence: 99%

“…[24][25][26]28,30,37,38,40,41,57,58 This was applicable to seven out of 12 (58.3%) procedure-specific tools. [31][32][33][42][43][44][45][46][47][48][49][50]59,60 Addison et al used crowd-sourced assessment of technical skills (CSATS) for GEARS and raters were routinely trained and evaluated for their rating reliability. 41 All APMs inherently demonstrate response process, as they are automated, hence removing rater bias, and theoretically having 100% reliability.…”

Section: Response Processmentioning

confidence: 99%

Objective assessment tools in laparoscopic or robotic‐assisted gynecological surgery: A systematic review

Tesfai,

Nagi,

Morrison

et al. 2024

Acta Obstet Gynecol Scand

View full text Add to dashboard Cite

IntroductionThere is a growing emphasis on proficiency‐based progression within surgical training. To enable this, clearly defined metrics for those newly acquired surgical skills are needed. These can be formulated in objective assessment tools. The aim of the present study was to systematically review the literature reporting on available tools for objective assessment of minimally invasive gynecological surgery (simulated) performance and evaluate their reliability and validity.Material and methodsA systematic search (1989–2022) was conducted in MEDLINE, Embase, PubMed, Web of Science in accordance with PRISMA. The trial was registered with the Prospective Register of Systematic Reviews (PROSPERO) ID: CRD42022376552. Randomized controlled trials, prospective comparative studies, prospective single‐group (with pre‐ and post‐training assessment) or consensus studies that reported on the development, validation or usage of assessment tools of surgical performance in minimally invasive gynecological surgery, were included. Three independent assessors assessed study setting and validity evidence according to a contemporary framework of validity, which was adapted from Messick's validity framework. Methodological quality of included studies was assessed using the modified medical education research study quality instrument (MERSQI) checklist. Heterogeneity in data reporting on types of tools, data collection, study design, definition of expertise (novice vs. experts) and statistical values prevented a meaningful meta‐analysis.ResultsA total of 19 746 titles and abstracts were screened of which 72 articles met the inclusion criteria. A total of 37 different assessment tools were identified of which 13 represented manual global assessment tools, 13 manual procedure‐specific assessment tools and 11 automated performance metrices. Only two tools showed substantive evidence of validity. Reliability and validity per tool were provided. No assessment tools showed direct correlation between tool scores and patient related outcomes.ConclusionsExisting objective assessment tools lack evidence on predicting patient outcomes and suffer from limitations in transferability outside of the research environment, particularly for automated performance metrics. Future research should prioritize filling these gaps while integrating advanced technologies like kinematic data and AI for robust, objective surgical skill assessment within gynecological advanced surgical training programs.

show abstract

“…2 VBAs offer several advantages. Videos can be reviewed asynchronously, and reviews can be blinded to reduce bias 3 and give the operating surgeon confidence in the scoring. However, VBAs are labor intensive as video footage needs to be scrubbed of sensitive data, edited for length, and sent to reviewers familiar with the operation.…”

mentioning

confidence: 99%