One Institution’s evaluation of family medicine residency applicant data for academic predictors of success

Busha, Michael E.; McMillen, Brock; Greene, Jeffrey A.; Gibson, Kristine; Milnes, Charlotte; Ziemkowski, Peter

doi:10.1186/s12909-021-02518-w

Cited by 4 publications

(2 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For full-text review, 82 articles were reviewed for inclusion and 14 were excluded, leaving 68 studies that met inclusion criteria. 16–83 Agreement on study inclusion achieved a κ value of 0.85.…”

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

The Association Between USMLE Step 2 Clinical Knowledge Scores and Residency Performance: A Systematic Review and Meta-Analysis

et al. 2023

View full text Add to dashboard Cite

Purpose With the change in Step 1 score reporting, Step 2 Clinical Knowledge (CK) may become a pivotal factor in resident selection. This systematic review and meta-analysis seeks to synthesize existing observational studies that assess the relationship between Step 2 CK scores and measures of resident performance. Method The authors searched MEDLINE, Web of Science, and Scopus databases using terms related to Step 2 CK in 2021. Two researchers identified studies investigating the association between Step 2 CK and measures of resident performance and included studies if they contained a bivariate analysis examining Step 2 CK scores’ association with an outcome of interest: in-training examination (ITE) scores, board certification examination scores, select Accreditation Council for Graduate Medical Education core competency assessments, overall resident performance evaluations, or other subjective measures of performance. For outcomes that were investigated by 3 or more studies, pooled effect sizes were estimated with random-effects models. Results Among 1,355 potential studies, 68 met inclusion criteria and 43 were able to be pooled. There was a moderate positive correlation between Step 2 CK and ITE scores (0.52, 95% CI 0.45–0.59, P < .01). There was a moderate positive correlation between Step 2 CK and ITE scores for both nonsurgical (0.59, 95% CI 0.51–0.66, P < .01) and surgical specialties (0.41, 95% CI 0.33–0.48, P < .01). There was a very weak positive correlation between Step 2 CK scores and subjective measures of resident performance (0.19, 95% CI 0.13–0.25, P < .01). Conclusions This study found Step 2 CK scores have a statistically significant moderate positive association with future examination scores and a statistically significant weak positive correlation with subjective measures of resident performance. These findings are increasingly relevant as Step 2 CK scores will likely become more important in resident selection.

show abstract

Section: Resultsmentioning

confidence: 99%

“…Forty-three studies were able to be pooled. 16–58 The results of all pooled analyses are summarized in Supplemental Digital Appendix 3 (at http://links.lww.com/ACADMED/B353). Most pooled analyses had an I 2 value suggestive of high heterogeneity between studies.…”

Section: Resultsmentioning

confidence: 99%