Do Orthopaedic In-Training Examination Scores Predict the Likelihood of Passing the American Board of Orthopaedic Surgery Part I Examination? An Update With 2014 to 2018 Data

Abstract

Introduction: Previous research shows a correlation in performance between the Orthopaedic In-Training Examination (OITE) and the American Board of Orthopaedic Surgery (ABOS) Certifying Examination Part I; however, these studies are not current, with the most recent data from 2009. The purpose of this study was to update the relationship between the OITE and ABOS Part I scores with the five most recent nationwide cohorts of Part I scores and their corresponding OITE scores. Methods: The American Academy of Orthopaedic Surgeons provided the results for each resident taking the OITE from 2013 to 2017. The ABOS provided the results for each resident taking the Part I examination from 2014 to 2018. These two datasets were matched at the individual level and analyzed. Results: Between 2014 and 2018, 3,502 first-time test-takers were present for the ABOS Part I Examination. A 96.6% pass rate was noted (3,383 of 3,502). A statistically significant correlation between the OITE score and ABOS Part I score was observed at all levels of training: postgraduate year (PGY) 1 r = 0.380, PGY2 r = 0.463, PGY3 r = 0.498, PGY4 r = 0.504, and PGY5 r = 0.504 (P < 0.001 for all correlations). Conclusion: The OITE scores continue to correlate with the ABOS scores and the pass rate for the ABOS with moderate strength correlation. However, although a correlation of the examinations exists when evaluated as a group, the predictive value of the OITE for passing the Part I examination for any specific individual is far from perfect. Individuals with PGY5 OITE percentile scores less than 10 pass the Part I examination, and individuals with PGY5 OITE percentile scores greater than 90 fail the Part I examination.

American Board of Orthopaedic Surgery’s Initiatives Toward Competency-Based Education

“…However, this test is designed primarily as an educational tool 9 . Unfortunately, the correlation of the OITE with the Part I Board Examination is only moderate 10 .…”

Cross-Sectional Analysis of Foot and Ankle Questions on the Orthopaedic In-Training Examination: A Guide for Resident Preparation

“…However, a minimum OITE score threshold that corresponded to passing the Part I Certifying Exam was not identified. 8 The usefulness of the OITE has been criticized because of this mismatch, outside of its ability to compare residents on baseline knowledge. The ABOS and AAOS have recently begun to collaborate on developing questions that are included on both the Part I Certifying Examination and the OITE, with the ultimate goal “to identify the score on the AAOS OITE that approximately corresponds to the minimum passing performance level on the ABOS Part I Certifying Examination.” 12 This score would be a valuable resource in guiding resident preparation for the ABOS examination.…”

Analysis of Orthopaedic In-Training Examination Trauma Questions: 2017 to 2021

“…For residents, the OITE scores, particularly in the last year of postgraduate training, correlate with the American Board of Orthopaedic Surgery part I scores. [4][5][6] For program directors, the OITE is the only national test to objectively assess a resident's orthopaedic knowledge both as a benchmark on the efficacy of the residency education curriculum and on the progress of their individual residents. 6 Given the importance of the examination, most residents are motivated to perform well, and most rely on an online learning platform, most commonly ResStudy and Orthobullets, to aid in preparation for the OITE.…”

“…[4][5][6] For program directors, the OITE is the only national test to objectively assess a resident's orthopaedic knowledge both as a benchmark on the efficacy of the residency education curriculum and on the progress of their individual residents. 6 Given the importance of the examination, most residents are motivated to perform well, and most rely on an online learning platform, most commonly ResStudy and Orthobullets, to aid in preparation for the OITE. Only a minority of residents use journal reading as their primary learning material.…”