Comparative Analysis of the American Board of Family Medicine and American College of Osteopathic Family Physicians In-Training Examinations

Abstract

Background and Objectives: Family medicine residency programs accredited by the Accreditation Council for Graduate Medical Education and the American Osteopathic Association typically require their residents to take the American Board of Family Medicine’s In-Training Examination (ITE) and the American College of Osteopathic Family Physicians’ In-Service Examination (ISE). With implementation of the single accreditation system (SAS), is it necessary to administer both examinations? This pilot study assessed whether the degree of similarity for the construct of family medicine knowledge and clinical decision making as measured by both exams is high enough to be considered equivalent and analyzed resident ability distribution on both exams. Methods: A repeated measures design was used to determine how similar and how different the rankings of PGY-3s were with regard to their knowledge of family medicine as measured by the ISE and ITE. Eighteen third-year osteopathic residents participated in the analysis, and the response rate was 100%. Results: The correlation between ISE and ITE rankings was moderately high and significantly different from zero (rs=.76, P<0.05). A Wilcoxon signed rank test indicated that the median ISE score of 62 was not statistically significantly different than the median ITE score of 71 (Z=-0.74, P=0.46, 2-tailed). Conclusions: The lack of a difference on statistical analysis of ISE scores and the ITE scores of the PGY-3 residents suggests that the cohort of osteopathic residents in family residency programs and the cohort of residents in ACGME-accredited programs seem to be of comparable ability, therefore there is no clear justification for administering both examinations.

Residency Program Perspective on In-Service Exams

“…I had the opportunity to work with the American Board of Family Medicine (ABFM) 5 years ago and engage in a comparative analysis of the AOBFP ISE and the ABFM In-Training Examination (ITE). 2 At the time, I chose to engage in that study because I was faculty in a department with multiple dually accredited family medicine residency programs where residents had been required to take both the ITE and the ISE on an annual basis. I felt this was unnecessary and did not add value to our assessment of their readiness to ultimately pass the certification examination at the end of residency.…”