USMLE Step 1 Scores as a Significant Predictor of Future Board Passage in Pediatrics

McCaskill, Quimby E.; Kirk, Jim; Barata, D. M.; Wludyka, Peter; Zenni, Elisa Alter; Chiu, Tai-Chia

doi:10.1016/j.ambp.2007.01.002

Cited by 80 publications

(53 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several groups have assessed the predictive validity of other high‐stakes medical examinations, including the United States Medical Licensing Examination ® (USMLE ® )8, 9, 10, the Quebec Licensing Examination11, the Medical Council of Canada Qualifying Examination12, 13, 14, the MRCP examination15, 16, 17 and Membership of the Royal College of General Practitioners examination15. Performance in these examinations predicts performance in clinical practice and other medical assessment processes11 18, 19.…”

Section: Discussionmentioning

confidence: 99%

Impact of performance in a mandatory postgraduate surgical examination on selection into specialty training

et al. 2017

View full text Add to dashboard Cite

BackgroundThe Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination is undertaken by large numbers of trainees in the UK and internationally as a mandatory step within surgical training. Unlike some high‐stakes medical examinations, the MRCS is yet to be validated. A quantitative study was undertaken to assess its predictive validity by investigating the relationship between MRCS (Parts A and B) and national selection interview scores for general and vascular surgery in the UK.MethodsPearson correlation coefficients were used to examine the linear relationship between each assessment, and linear regression analyses were employed to identify potential independent predictors of the national selection score. All UK medical graduates who attempted the interview in 2011–2015 were included.ResultsSome 84·4 per cent of the candidates (1231 of 1458) were matched with MRCS data. There was a significant positive correlation between the first attempt score at Part B of the MRCS examination and the national selection score (r = 0·38, P < 0·001). In multivariable analysis, 17 per cent of variance in the national selection first attempt score was explained by the Part B MRCS score and number of attempts (change in R 2 value of 0·10 and 0·07 respectively; P < 0·001). Candidates who required more than two attempts at Part B were predicted to score 8·1 per cent less than equally matched candidates who passed at their first attempt.ConclusionThis study supports validity of the MRCS examination, and indicates its predictive value regarding entry into specialist training.

show abstract

Section: Discussionmentioning

confidence: 99%

Impact of performance in a mandatory postgraduate surgical examination on selection into specialty training

et al. 2017

View full text Add to dashboard Cite

show abstract

“…28 Studies in other specialties have also demonstrated that USMLE scores were positive predictors of specialty board certification. 4,[6][7][8][9][10][11][12][13][14][15][16][17] In 1986, Warrick and Crumrine 32 actually found a negative correlation between the National Board of Medical Examiners (NBME) Part 1 examination, which the USMLE Step 1 examination has replaced, and the ABA-ASA ITE. In that study, higher scores on the NBME Part 1 examination were associated with lower ABA-ASA ITE scores.…”

Section: Table 2 Stepwise Regression Analyses Predictors From Ites Bmentioning

confidence: 99%

“…Studies in other specialties have largely demonstrated that USMLE Step 1 and Step 2 scores were positive predictors of specialty board certification. 4,[6][7][8][9][10][11][12][13][14][15][16][17] However, one study involving ophthalmology residents failed to find a correlation between USMLE Step 1 and the ophthalmology specialty board examination. 18 Quantitative academic assessments of resident performance are typically collected during the course of residency.…”

Section: Introductionmentioning

confidence: 99%

Predictors of success on the written anesthesiology board certification examination

et al. 2012

View full text Add to dashboard Cite

Objectives: To determine whether information available prior to and during anesthesia residency training can predict American Board of Anesthesiology (ABA) Part 1 (Written) performance and help identify anesthesia residents at risk for failure. Methods: Retrospective analysis of 97 anesthesiology residents' academic files at a single Midwestern residency program. ABA Part 1 score was used as the dependent variable. Categorical demographic predictor variables included gender, under-represented minority status, and type of medical degree. Quantitative academic predictor variables included first-attempt scores on United States Medical Licensing Examination (USMLE) Steps 1 and 2, annual ABA In-Training Exam (ITE) scores, and biannual Basic Science Examination (BSE) scores. Predictors that correlated significantly with the dependent variable were entered into stepwise linear regression analyses. Results:In our analyses, only the USMLE Step 2 score was a significant pre-residency predictor (B=0.169; SE=0.031, p<0.001). Scores on ITEs were significant predictors at every time point. In the final regression model using all available measures during residency, the most recent ITE (B = 0.627; SE=0.090; p<0.001) and BSE (B=0.096; SE = 0.047; p=0.046) scores were significant predictors. The model accounted for 52% of the variance in the outcome variable, with 50% of the variance explained by ITE score alone. The model had a specificity of 0.83 and a sensitivity of 0.82 for predicting passing the ABA Part 1 exam. Conclusions: First-attempt scores on the USMLE Step 2 examination and the CA-2 ITE are moderately strong predictors of anesthesiology board examination performance, and may help target residents who are at risk of failing.

show abstract

“…Previous studies have shown a relationship between results on part 1 of the National Board of Medical Examiners test and future performance on subspecialty board examinations. 1,2 More recently, a similar relationship has been seen with USMLE step 1 scores and board performance in medical residencies [3][4][5] and dental medicine training programs. 6 Some training programs, such as orthopedic surgery programs, have shown less-significant correlations between step 1 scores and pass/failure rates on future subspecialty boards.…”

mentioning

confidence: 60%

“…Other residency programs, including pediatrics, internal medicine, and radiology, have previously shown that step 1 examination scores in medical school correlate with subspecialty board scores. [3][4][5] The aim of this study was to investigate whether the 2-digit scores on step 1 of the USMLE correlate with ABP performance in the UPMC pathology program.…”

mentioning

confidence: 99%

United States Medical Licensing Examination Step 1 Two-Digit Score: A Correlation With the American Board of Pathology First-Time Test Taker Pass/Fail Rate at the University of Pittsburgh Medical Center

Picarsic

Raval

Macpherson

2011

Archives of Pathology &Amp; Laboratory Medicine

View full text Add to dashboard Cite

N Context.-Factors that correlate with success or failure on the American Board of Pathology (ABP) examination are not known. Other medical residency programs have shown that standardized test scores correlate with specialty board examination scores; however, data from pathology programs are lacking.Objective.-To investigate whether the 2-digit score on step 1 of the United States Medical Licensing Examination (USMLE) was correlated with ABP examination performance at a large university pathology program.Design.-Nine years of data (2001)(2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009)) from pathology residents (n = 72) at the University of Pittsburgh Medical Center (UPMC, Pittsburgh, Pennsylvania) was collected from existing files and deidentified.Step 1 USMLE 2-digit scores and ABP failure rates for first-time test takers were compared. Results are reported as the percentage of residents who failed either the anatomic pathology or clinical pathology part of the ABP examination in cohorts by their USMLE 2-digit score (#80, 81-85, 86-89, $90).Results.-The rolling 5-year (2005-2009) ABP average failure rate for first-time test takers of the anatomic pathology examination was 3.1% % (UPMC) and 14.1% % (nationally); in clinical pathology, it was 13.8% % (UPMC) and 23.6% % (nationally). At UPMC, no resident failed the anatomic pathology or clinical pathology parts of the ABP examination if his or her 2-digit USMLE step 1 score was 90 or more across 9 years of training (2001)(2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009).Conclusions.-In the UPMC pathology program, 2-digit scores on USMLE step 1 of 90 or more and 80 or less were strong measures of ABP first-time pass/failure rates, whereas scores of 81 to 89 were less-accurate measures. The USMLE step 1 score is one of many criteria that can be used for screening applicants for a pathology residency program.

show abstract

USMLE Step 1 Scores as a Significant Predictor of Future Board Passage in Pediatrics

Cited by 80 publications

References 10 publications

Impact of performance in a mandatory postgraduate surgical examination on selection into specialty training

Impact of performance in a mandatory postgraduate surgical examination on selection into specialty training

Predictors of success on the written anesthesiology board certification examination

United States Medical Licensing Examination Step 1 Two-Digit Score: A Correlation With the American Board of Pathology First-Time Test Taker Pass/Fail Rate at the University of Pittsburgh Medical Center

Contact Info

Product

Resources

About