Relationship Between Performance on Part I of the American Board of Orthopaedic Surgery Certifying Examination and Scores on USMLE Steps 1 and 2

Swanson, David B.; Sawhill, Amy; Holtzman, Kathleen Z.; Bucak, S. Deniz; Morrison, Carol; Hurwitz, Shepard R.; DeRosa, G. Paul

doi:10.1097/acm.0b013e3181b37fd2

Cited by 53 publications

(51 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…6,[8][9][10][11][12][13][14][15][17][18][19][20][21][22][23][24][25] The results from our study also indicate that predictors such as those ITEs that test knowledge gained over the first two years of anesthesiology training can be used as predictors of passing the ABA Part 1 examination. However, we did not find either the PGY-0 ITE (administered at the beginning of the intern year) or the CB ITE (administered at the beginning of the CA-1/first anesthesiology residency year) to be particularly good predictors of passing the ABA Part 1 examination.…”

Section: Table 2 Stepwise Regression Analyses Predictors From Ites Bmentioning

confidence: 73%

“…28 Studies in other specialties have also demonstrated that USMLE scores were positive predictors of specialty board certification. 4,[6][7][8][9][10][11][12][13][14][15][16][17] In 1986, Warrick and Crumrine 32 actually found a negative correlation between the National Board of Medical Examiners (NBME) Part 1 examination, which the USMLE Step 1 examination has replaced, and the ABA-ASA ITE. In that study, higher scores on the NBME Part 1 examination were associated with lower ABA-ASA ITE scores.…”

Section: Table 2 Stepwise Regression Analyses Predictors From Ites Bmentioning

confidence: 99%

“…Studies in other specialties have largely demonstrated that USMLE Step 1 and Step 2 scores were positive predictors of specialty board certification. 4,[6][7][8][9][10][11][12][13][14][15][16][17] However, one study involving ophthalmology residents failed to find a correlation between USMLE Step 1 and the ophthalmology specialty board examination. 18 Quantitative academic assessments of resident performance are typically collected during the course of residency.…”

Section: Introductionmentioning

confidence: 99%

“…Several studies in multiple other medical specialties have shown that annual American Board of Medical Specialties (ABMS) In-Training Examinations (ITEs) are good predictors of performance on the specialty board certification examination. 6,[8][9][10][11][12][13][14][15][17][18][19][20][21][22][23][24][25] ITEs occur yearly during residency training and are typically mandatory except during extenuating circumstances such as illness or a leave of absence. This relationship between ITEs and board certification has been demonstrated in anesthesiology as well.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Predictors of success on the written anesthesiology board certification examination

et al. 2012

View full text Add to dashboard Cite

Objectives: To determine whether information available prior to and during anesthesia residency training can predict American Board of Anesthesiology (ABA) Part 1 (Written) performance and help identify anesthesia residents at risk for failure. Methods: Retrospective analysis of 97 anesthesiology residents' academic files at a single Midwestern residency program. ABA Part 1 score was used as the dependent variable. Categorical demographic predictor variables included gender, under-represented minority status, and type of medical degree. Quantitative academic predictor variables included first-attempt scores on United States Medical Licensing Examination (USMLE) Steps 1 and 2, annual ABA In-Training Exam (ITE) scores, and biannual Basic Science Examination (BSE) scores. Predictors that correlated significantly with the dependent variable were entered into stepwise linear regression analyses. Results:In our analyses, only the USMLE Step 2 score was a significant pre-residency predictor (B=0.169; SE=0.031, p<0.001). Scores on ITEs were significant predictors at every time point. In the final regression model using all available measures during residency, the most recent ITE (B = 0.627; SE=0.090; p<0.001) and BSE (B=0.096; SE = 0.047; p=0.046) scores were significant predictors. The model accounted for 52% of the variance in the outcome variable, with 50% of the variance explained by ITE score alone. The model had a specificity of 0.83 and a sensitivity of 0.82 for predicting passing the ABA Part 1 exam. Conclusions: First-attempt scores on the USMLE Step 2 examination and the CA-2 ITE are moderately strong predictors of anesthesiology board examination performance, and may help target residents who are at risk of failing.

show abstract

Section: Table 2 Stepwise Regression Analyses Predictors From Ites Bmentioning

confidence: 73%

Section: Table 2 Stepwise Regression Analyses Predictors From Ites Bmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Predictors of success on the written anesthesiology board certification examination

et al. 2012

View full text Add to dashboard Cite

show abstract

“…3,[8][9][10][18][19][20][21][22][23][24][25][26][27][28][29] Another predictor of specialty board written examination performance is the prior score on the United States Medical Licensing Examination (USMLE). 10,11,[28][29][30][31] While USMLE scores are positively correlated, by itself, USMLE performance does not guarantee success on certification examination. In a study of orthopedic surgeons, doing well on the USMLE Step I examination did not guarantee passage of the American Board of Orthopedic Surgery (ABOS) Part I examination (similar to the ABEM qualifying examination).…”

Section: Discussionmentioning

confidence: 99%

Delaying the American Board of Emergency Medicine Qualifying Examination Is Associated With Poorer Performance

Marco

Counselman

Korte

et al. 2014

Academic Emergency Medicine

View full text Add to dashboard Cite

Objectives: The initial step in certification by the American Board of Emergency Medicine (ABEM) requires passing a multiple-choice-question qualifying examination. The qualifying examination is typically taken in the first year after residency training. This study was undertaken to determine if a delay in taking the qualifying examination is associated with poorer performance. The authors also examined the relationship between in-training examination scores and qualifying examination scores.Methods: This was a pooled time-series cross-section study. Primary measurements were initial qualifying examination scores, the timing of the qualifying examination, and in-training examination scores. The three groups, based on qualifying examination timing, were immediate, 1-year delay, and ≥2-year delay. In-training examination scores were analyzed to determine the relationship between intrinsic ability, examination timing, and qualifying examination scores. For analysis, a generic pooled ordinary least-squares dummy variable model with robust standard errors was used. A pre hoc level of significance was determined to be a < 0.01.Results: There were 16,353 qualifying examination test administrations between 2000 and 2012. Intraining examination scores were positively correlated with qualifying examination scores (p < 0.001). The group pass rates were 98.9% immediate, 95.6% 1-year delay, and 86.6% ≥2-year delay. After controlling for in-training examination scores, delay taking the qualifying examination of 1 year was associated with a decrease in score of -0.6 (p = 0.003). A delay in taking the qualifying examination ≥2 years was associated with a decrease in score of -2.5 points (p < 0.001).

show abstract

Factors Associated With American Board of Medical Specialties Member Board Certification Among US Medical School Graduates

Jeffe¹,

Andriole²

2011

JAMA

View full text Add to dashboard Cite

Context Certification by an American Board of Medical Specialties (ABMS) member board is emerging as a measure of physician quality. Objective To identify demographic and educational factors associated with ABMS-member-board certification of US medical graduates. Design, Setting, Participants Retrospective study of a national cohort of 1997–2000 US medical graduates, grouped by specialty choice at graduation and followed up through March 2, 2009. In separate multivariable logistic regression models for each specialty category, factors associated with ABMS-member-board certification were identified. Main Outcome Measure ABMS-member-board certification Results Of 42 440 graduates in the study sample, 37 054 (87.3%) were board certified. Graduates in all specialty categories with first-attempt passing scores in the highest tertile (vs first-attempt failing scores) on US Medical Licensing Examination Step 2 Clinical Knowledge were more likely to be board certified; adjusted odds ratios (aOR) varied by specialty category with the lowest odds for emergency medicine (87.4% vs 73.6%; aOR, 1.82; 95% confidence interval [CI], 1.03–3.20) and highest odds for radiology (98.1% vs 74.9%; aOR, 13.19; 95% CI, 5.55–31.32). In each specialty category except family medicine, graduates self-identified as underrepresented racial/ethnic minorities (vs white) were less likely to be board certified, ranging from 83.5% vs 95.6% in the pediatrics category (aOR, 0.44; 95% CI, 0.33–0.58) to 71.5% vs 83.7% in the other non-generalist specialties category (aOR, 0.79; 95% CI, 0.64–0.96). With each $50 000 unit increase in debt (vs no debt), graduates choosing obstetrics/gynecology were less likely to be board certified (aOR, 0.89; 95% CI, 0.83–0.96), and graduates choosing family medicine were more likely to be board certified (aOR 1.13; 95% CI, 1.01–1.26). Conclusion Demographic and educational factors were associated with board certification among US medical graduates in every specialty category examined; findings varied among specialty categories.

show abstract

Relationship Between Performance on Part I of the American Board of Orthopaedic Surgery Certifying Examination and Scores on USMLE Steps 1 and 2

Abstract: There is continuing empirical support for use of Step 1 and Step 2 scores in selection of residents to interview for orthopedics residency positions.

Cited by 53 publications

References 2 publications

Predictors of success on the written anesthesiology board certification examination

Predictors of success on the written anesthesiology board certification examination

Delaying the American Board of Emergency Medicine Qualifying Examination Is Associated With Poorer Performance

Factors Associated With American Board of Medical Specialties Member Board Certification Among US Medical School Graduates

Contact Info

Product

Resources

About