Performance on the Adult Rheumatology In‐Training Examination and Relationship to Outcomes on the Rheumatology Certification Examination

Abstract

Objective. The American College of Rheumatology (ACR) Adult Rheumatology In-Training Examination (ITE) is a feedback tool designed to identify strengths and weaknesses in the content knowledge of individual fellows-in-training and the training program curricula. We determined whether scores on the ACR ITE, as well as scores on other major standardized medical examinations and competency-based ratings, could be used to predict performance on the American Board of Internal Medicine (ABIM) Rheumatology Certification Examination.Methods. Between 2008 and 2012, 629 second-year fellows took the ACR ITE. Bivariate correlation analyses of assessment scores and multiple linear regression analyses were used to determine whether ABIM Rheumatology Certification Examination scores could be predicted on the basis of ACR ITE scores, United States Medical Licensing Examination scores, ABIM Internal Medicine Certification Examination scores, fellowship directors' ratings of overall clinical competency, and demographic variables. Logistic regression was used to evaluate whether these assessments were predictive of a passing outcome on the Rheumatology Certification Examination.Results. In the initial linear model, the strongest predictors of the Rheumatology Certification Examination score were the second-year fellows' ACR ITE scores (b 5 0.438) and ABIM Internal Medicine Certification Examination scores (b 5 0.273). Using a stepwise model, the strongest predictors of higher scores on the Rheumatology Certification Examination were second-year fellows' ACR ITE scores (b 5 0.449) and ABIM Internal Medicine Certification Examination scores (b 5 0.276). Based on the findings of logistic regression analysis, ACR ITE performance was predictive of a pass/fail outcome on the Rheumatology Certification Examination (odds ratio 1.016 [95% confidence interval 1.011-1.021]).Conclusion. The predictive value of the ACR ITE score with regard to predicting performance on the Rheumatology Certification Examination supports use of the Adult Rheumatology ITE as a valid feedback tool during fellowship training.In-Training Examinations (ITEs) can be useful formative assessment tools used across medical specialties and subspecialties to assess developing knowledge during postgraduate training while providing valuable

Medical Knowledge Assessment by Hematology and Medical Oncology In-Training Examinations Are Better Than Program Director Assessments at Predicting Subspecialty Certification Examination Performance

“…Like other recent studies [8,9], we found performance on the ITEs designed for hematology and oncology trainees to be predictive of performance on subsequent ABIM IM subspecialty certification examinations. This was especially important when the results in the final year of training were considered.…”

“…The first administration of these examinations was in 2009 and 2008, respectively. ITE scores have been associated with subsequent specialty board certification in IM and board certification in the subspecialties of infectious disease and rheumatology [5][6][7][8][9]. The NBME's United States Medical Licensing Examination (USMLE), a three-step examination taken in medical school, also positively predicts performance on the IM certification examination [10].…”

Role of formative assessment in predicting academic success among GP registrars: a retrospective longitudinal study

“…While there are limited studies on the predictive role of in-training assessment in GP training, numerous studies in other specialities have identified the predictive role of in-training examinations in fellowship exams. [29][30][31] The internal MCQs were designed as formative feedback tools to assist the trainees and trainers to assess mastery of content and competence while serving as a guidepost for the fellowship examination. 32 Evidence from our study has enabled the JCU GPT programme to intervene early in providing additional support for trainees at risk of failing to progress through the training programme.…”

Performance on the Nephrology In-Training Examination and ABIM Nephrology Certification Examination Outcomes

“…In-training examinations can provide objective evidence regarding a trainee's readiness to successfully complete the corresponding board certification examination and thus, allow implementation of remediation plans if needed. A growing number of studies have indicated that in-training examination performance has a positive relationship with performance on the respective board certification examination within a variety of medical specialties (3)(4)(5)(6)(7)(8)(9)(10). Generally, average to high scores on these examinations yield a high probability of passing the respective board certification examination.…”