Association Between Performance on COMLEX-USA and the American College of Osteopathic Family Physicians In-Service Examination

Hudson, Kimberly M; Feinberg, Gail; Hempstead, Laura; Zipp, Christopher; Gimpel, John R.; Wang, Yi

doi:10.4300/jgme-d-17-00997.1

Cited by 8 publications

(5 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The simple fact is that the majority of allopathic programs are more comfortable evaluating the USMLE and not COMLEX and there is precedent for osteopathic students to take the USMLE and not the other way around. Although neither exam is perfect at evaluating resident performance, there is data on both sides that show a positive correlation between success in COMLEX and USMLE and residency performance [27,28]. It is also unclear which examination better predicts residency outcomes as, to our knowledge, no studies exist.…”

Section: Resultsmentioning

confidence: 99%

Predicting Osteopathic Medical Student Performance on the United States Medical Licensing Examination Step 2 Clinical Knowledge From Results of the Comprehensive Osteopathic Medical Licensing Examination Level 2-Cognitive Evaluation

Smith¹,

Carmody²,

Kauffman³

et al. 2021

Cureus

View full text Add to dashboard Cite

Section: Resultsmentioning

confidence: 99%

Predicting Osteopathic Medical Student Performance on the United States Medical Licensing Examination Step 2 Clinical Knowledge From Results of the Comprehensive Osteopathic Medical Licensing Examination Level 2-Cognitive Evaluation

Smith¹,

Carmody²,

Kauffman³

et al. 2021

Cureus

View full text Add to dashboard Cite

“…Several studies have examined the link between osteopathic assessments across the continuum from undergraduate medical examinations (UME) such as COMLEX-USA, to osteopathic assessments (and others) in GME. [4][5][6][7][8] These studies have looked at correlations as osteopathic medical students progressed through medical education and osteopathic licensure examinations, to in-service examinations, to board certification, and to performance in practice. 9 The best-known studies involve the American Board of Family Medicine (ABFM) certification examination and other medical examinations such as the ITE or COMLEX-USA.…”

Section: Original Articlesmentioning

confidence: 99%

The Predictive Value of the Residency AOBFP In-Service Exam, Produced and Administered by ACOFP

Torres

Bowling

Zipp

et al. 2022

Fam Med

Self Cite

View full text Add to dashboard Cite

Background and Objectives: Board certification is acknowledged as the mainstay for ensuring quality physician-delivered health care within medical specialties. The American College of Osteopathic Family Physicians (ACOFP) administers the American Osteopathic Board of Family Physicians’ (AOBFP) In-Service Examination (ISE) to provide residents and program directors with a formative examination to assess competency and preparation for successful completion of the AOBFP certifying examination (CE). Unique assessment processes are integral to monitoring development of the osteopathic family physician throughout training and into practice, and to verify their competency for the safety and protection of the public. This study sought to investigate whether performance on the AOBFP ISE predicted performance on the AOBFP CE, and thereby successfully equipped residents to safely enter medical practice. Methods: In 2020, data from 1,893 PGY-1 through PGY-3 residents (2016-2018), whose ISE scores could be matched with scores on the AOBFP initial board CE, were analyzed for this study. Results: Correlations among ISE administrations across 3 years of postgraduate medical education were in the mid-to-high .6 range; the ISE scores correlated with CE scores in the mid .4 to high .5 range. Less reliable measures of positive predictive value were 0.99, and sensitivity was 0.91. Conclusions: Results suggest that ISE administrations during residency training are effective in developing remediation strategies for subsequent successful CE performance. The inclusion of osteopathic principles in the AOBFP CE necessitates inclusion of osteopathic content in resident training exams like ISE.

show abstract

“…However, the relative importance of USMLE scores when EM program directors determine their applicant rank list has varied in published reports [14][15][16]. Multiple other specialties, including family medicine [17,18], general surgery [19], internal medicine [20,21], internal medicine/pediatrics [22], and obstetrics [23], have all examined the correlations between either licensure examinations or specialty ITE with specialty board certification examinations, with varying degrees of prediction [24].…”

Section: Introductionmentioning

confidence: 99%

Can USMLE and COMLEX-USA Scores Predict At-Risk Emergency Medicine Residents' Performance on In-Training Examinations?

Plewa,

Ledrick,

Jenkins

et al. 2024

Cureus

View full text Add to dashboard Cite

Purpose: The United States Medical Licensing Examination (USMLE) and Comprehensive Osteopathic Medical Licensing Examination (COMLEX) scores are standard methods used to determine residency candidates' medical knowledge. The authors were interested in using the USMLE and COMLEX part 2 scores in our emergency medicine (EM) residency program to identify at-risk residents who may have difficulty on the in-training exam (ITE) and to determine the cutoff values under which an intern could be given an individualized study plan to ensure medical knowledge competency. Methods: The authors abstracted the USMLE and COMLEX part 2 scores and the American Board of Emergency Medicine (ABEM) ITE scores for a cohort of first-year EM residents graduating years 2010-2022, converting raw scores to percentiles, and compared part 2 and ABEM ITE scores with Pearson's correlation, a Bland-Altman analysis of bias and 95% limits of agreement, and ROC analysis to determine optimal the cut-off values for predicting ABEM ITE < 50 th percentile and the estimated test characteristics. Results: Scores were available for 152 residents, including 93 USMLE and 88 COMLEX exams. The correlations between part 2 scores and ABEM ITE were r = 0.36 (95%CI: 0.17, 0.52; p < 0.001) for USMLE and r = 0.50 (95%CI: 0.33, 0.64; p < 0.001) for COMLEX. Bias and limits of agreement for both part 2 scores were -14 ± 63% for USMLE and 13 ± 50% for COMLEX in predicting the ABEM ITE scores. USMLE < 37 th percentile and COMLEX < 53 rd percentile identified 42% (N = 39) and 27% (N = 24) of EM residents, respectively, as at risk, with a sensitivity of 61% and 49% and specificity of 71% and 92%, respectively. Conclusion: USMLE and COMLEX part 2 scores have a very limited role in identifying those at risk of low ITE performance, suggesting that other factors should be considered to identify interns in need of medical knowledge remediation.

show abstract

Association Between Performance on COMLEX-USA and the American College of Osteopathic Family Physicians In-Service Examination

Cited by 8 publications

References 5 publications

Predicting Osteopathic Medical Student Performance on the United States Medical Licensing Examination Step 2 Clinical Knowledge From Results of the Comprehensive Osteopathic Medical Licensing Examination Level 2-Cognitive Evaluation

Predicting Osteopathic Medical Student Performance on the United States Medical Licensing Examination Step 2 Clinical Knowledge From Results of the Comprehensive Osteopathic Medical Licensing Examination Level 2-Cognitive Evaluation

The Predictive Value of the Residency AOBFP In-Service Exam, Produced and Administered by ACOFP

Can USMLE and COMLEX-USA Scores Predict At-Risk Emergency Medicine Residents' Performance on In-Training Examinations?

Contact Info

Product

Resources

About