USMLE Scores Predict Success in ABEM Initial Certification: A Multicenter Study

Harmouche, Elie; Goyal, Nikhil; Pinawin, Ashley; Nagarwala, Jumana; Bhat, Rahul

doi:10.5811/westjem.2016.12.32478

Cited by 44 publications

(36 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The results from our study showed that the USMLE Steps scores [13]. There are reports of consistent results showing a correlation between USMLE scores and the results of the certification examination in various specialties and subspecialties [15][16][17][18][19]. Higher USMLE…”

Section: Usmle Scores (Mean (Sd))supporting

confidence: 67%

See 1 more Smart Citation

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

et al. 2020

View full text Add to dashboard Cite

Background: To evaluate if United States Medical Licensing Examination (USMLE) Step 1, USMLE Step 2 CK, USMLE Step 3, and residency third-year in-service training exam (ITE) scores predict the results of American Board of Internal Medicine Certifying Exam (ABIM-CE). Methods: We performed a retrospective review of USMLE Step 1, USMLE Step 2 CK, USMLE Step 3, third-year residency ITE scores and ABIM-CE results of IM residents at our residency program from 2004 through 2017. Statistical analysis was perfrormed using Pearson correlation coefficient, and logistic regression to assess the relationship between USMLE Step 1, USMLE Step 2CK, USMLE Step 3, 3rd year ITE scores and ABIM-CE results. We used Multivariate logistic regression to predict pass or fail results in ABIM-CE based on USMLE and third-year ITE test scores controlling for other covariates.Results: Among 114 Internal Medicine MD residents included in the study, 92% (n = 105) passed the ABIM-CE. The OR of passing ABIM-CE was 2.70 (95% CI = 1.38-5.29), 2.31 (95% CI = 1.33-4.01), and 1.63 (95% CI = 0.81-3.29) with a ten-point increase in USMLE Step 1, USMLE Step 2 CK and USMLE Step 3 scores respectively. The OR of ABIM-CE passing chance was 2.96 (95% CI = 0.95-9.20), with a ten-point increase in the average score of the above three exams. A 5 % increase in ITE percentage raised the likelihood of passing ABIM-CE (OR 2.92, 95% CI 1.15-7.38). All residents who failed ABIM-CE had Step 1 scores < 220. Among 31 residents with Step 2 CK score < 220, 20% (n = 6) failed ABIM. Similarly, 9% of residents with USMLE Step 3 score < 220 failed ABIM-CE; all residents who failed had scored < 220. The probability curve predicted that the chance of passing ABIM-CE was around 80% with USMLE scores greater than 200 and increased to almost 100% with USMLE scores of 250 or more. Conclusion: USMLE Step 1, USMLE Step 2 CK, and third-year ITE scores can predict the chances of passing ABIM-CE. The third-year ITE score has a higher preditive value compared to USMLE Step 1 and USMLE Step 2 scores. USMLE Step 1 scores more predictive of ABIM-CE results compared to USMLE Step 2CK scores. Thus, residency programs can identify internal medicine residents at risk of failing ABIM-CE and formulate interventions at an early stage during residency training. Measures such as enrolling them in question banks or board review courses can be helpful in improving their chances of passing ABIM-CE. Keywords: USMLE Step 1, USMLE Step 2CK, USMLE Step 3, 3rd year in-training exam results, American board of internal medicine certifying exam (ABIM-CE)

show abstract

Section: Usmle Scores (Mean (Sd))supporting

confidence: 67%

“…Step 1, USMLE Step 2 CK, and composite scores were also associated with better performance on Emergency Medicine boards, with USMLE Step 2 scores being the strongest predictor [18]. Lower USMLE Step 1 score was previously found to be predictive of failing certifying exams in surgery and pediatrics [19,20].…”

Section: Usmle Scores (Mean (Sd))mentioning

confidence: 80%

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

et al. 2020

View full text Add to dashboard Cite

show abstract

“…The value and predictive power of traditional evaluations remain debatable, although it does seem that certain standardized tests can predict later scores, grades, and achievement . In the field of postgraduate medical education, higher scores on Step 1 of the United States Medical Licensing Examination (USMLE) confer a greater likelihood of passing the specialty boards after training in general surgery, pediatrics, obstetrics and gynecology, and emergency medicine (EM) . However, test‐taking aptitude and knowledge acquisition are not the only domains that determine the effectiveness of physicians.…”

mentioning

confidence: 99%

Faculty Assessment of Emergency Medicine Resident Grit: A Multicenter Study

Olson

Olson²,

Williamson

et al. 2018

AEM Education and Training

View full text Add to dashboard Cite

Background: Assessment of trainees' competency is challenging; the predictive power of traditional evaluations is debatable especially in regard to noncognitive traits. New assessments need to be sought to better understand affective areas like personality. Grit, defined as "perseverance and passion for long-term goals," can assess aspects of personality. Grit predicts educational attainment and burnout rates in other populations and is accurate with an informant report version. Self-assessments, while useful, have inherent limitations. Faculty's ability to accurately assess trainees' grit could prove helpful in identifying learner needs and avenues for further development.Objective: This study sought to determine the correlation between EM resident self-assessed and facultyassessed Grit Scale (Grit-S) scores of that same resident.Methods: Subjects were PGY-1 to -4 EM residents and resident-selected faculty as part of a larger multicenter trial involving 10 EM residencies during 2017. The Grit-S Scale was administered to participating EM residents; an informant version was completed by their self-selected faculty. Correlation coefficients were computed to assess the relationship between residents' self-assessed and the residents' faculty-assessed Grit-S score.

show abstract

“…Much of an ERAS application is subjective (i.e., letters of recommendation, curriculum vitae) such that there is little objective information to help differentiate a higher‐tier applicant from a lower one. Currently, the USMLE score is the most discerning part of the application as it correlates with board certification pass rates and success on in‐training examinations …”

Section: Discussionmentioning

confidence: 99%

The Standardized Video Interview: How Does It Affect the Likelihood to Invite for a Residency Interview?

Husain

Ardolic

et al. 2019

AEM Education and Training

View full text Add to dashboard Cite

Background: The Association of American Medical Colleges instituted a standardized video interview (SVI) forall applicants to emergency medicine (EM). It is unclear how the SVI affects a faculty reviewer's decision on likelihood to invite an applicant (LTI) for an interview.Objectives: The objective was to determine whether the SVI affects the LTI.Methods: Nine Accreditation Council of Graduate Medication Education (ACGME)-accredited EM residency programs participated in this prospective, observational study. LTI was defined on a 5-point Likert scale as follows: 1 = definitely not invite, 2 = likely not invite, 3 = might invite, 4 = probably invite, 5 = definitely invite. LTI was recorded at three instances during each review: 1) after typical screening (blinded to the SVI), 2) after unblinding to the SVI score, and 3) after viewing the SVI video.Results: Seventeen reviewers at nine ACGME-accredited residency programs participated. We reviewed 2,219 applications representing 1,424 unique applicants. After unblinding the SVI score, LTI did not change in 2,065 (93.1%), increased in 85 (3.8%) and decreased in 69 (3.1%; p = 0.22). In subgroup analyses, the effect of the SVI on LTI was unchanged by United States Medical Licensing Examination score. However, when examining subgroups of SVI scores, the percentage of applicants in whom the SVI score changed the LTI was significantly different in those that scored in the lower and upper subgroups (p < 0.0001). The SVI video was viewed in 816 (36.8%) applications. Watching the video did not change the LTI in 631 (77.3%); LTI increased in 106 (13.0%) and decreased in 79 (9.7%) applications (p = 0.04).

show abstract

USMLE Scores Predict Success in ABEM Initial Certification: A Multicenter Study

Cited by 44 publications

References 21 publications

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

Faculty Assessment of Emergency Medicine Resident Grit: A Multicenter Study

The Standardized Video Interview: How Does It Affect the Likelihood to Invite for a Residency Interview?

Contact Info

Product

Resources

About