Is Poor Performance on NBME Clinical Subject Examinations Associated With a Failing Score on the USMLE Step 3 Examination?

Dong, Ting; Swygert, Kimberly A.; Durning, Steven J.; Saguil, Aaron; Zahn, Christopher M.; DeZee, Kent J.; Gilliland, William R.; Cruess, David F.; Balog, Erin K.; Servey, Jessica T.; Welling, David R.; Ritter, E. Matthew; Goldenberg, Matthew; Ramsay, Laura; Artino, Anthony R.

doi:10.1097/acm.0000000000000222

Cited by 18 publications

(15 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Despite these limitations, its low student performance and low degree of correlation with UAEU clinical experiences might indicate a low degree of utility for use of NBMESEs as a summative assessment tool for internal medicine clerkship in UAE (Fielding, 2008;Dong et al, 2014;Casey et al, 2016). If these results are confirmed through further study, the scores of the NBMESEs should not be used to determine pass-fail decisions in UAEU and the relative weight of NBMESE scores in the computed final composite clerkship scores should be considered carefully (Fielding, 2008).…”

Section: Discussionmentioning

confidence: 99%

“…The National Board of Medical Examiners Subject Exams (NBMESE) is a highly regarded tool used in the assessment of the clinical knowledge that students acquired during clerkship (Bass et al, 1997;Elnicki, Lescisin and Case, 2002). Furthermore many reports in the United States (US) highlight the relationship of NBME scores with the quality of clinical teaching and student clinical experiences (Nahum, 2004;Griffith et al, 2009;Ramchandani, 2011;Dong et al, 2014;Myers et al, 2014;Ouyang, Cuddy and Swanson, 2015;Casey et al, 2016).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Does performance on United States national board of medical examiners reflect student clinical experiences in United Arab Emirates?

Bakoush¹,

Dhanhani²,

Al-Shamsi³

et al. 2019

MedEdPublish

View full text Add to dashboard Cite

Background: A number of medical schools around the world use the United States National Board of Medical Examiners Subject Examinations as a clerkship assessment of student performance, yet these exams were blueprinted against the United States national core clerkship curriculum which might not be the same as the local curricula to which they are applied in other parts of the world. In this study, we investigated the correlations between the internal medicine clinical experiences at United Arab Emirates University with student performance on the National Board of Medical Examiners subject of internal medicine (NBME). Methods: One hundred and seven junior clerkship students out of 145 (74%) who finished their Internal Medicine clerkship during academic years 2014-2015 and 2015-2016 participated in this study. The students' clinical experiences were measured by the clinical learning evaluation questionnaire (CLEQ) and by the logged number of meaningful patient contacts during their internal medicine clerkship. Results: Linear regression analysis showed no significant association between performance on the subject test and student clinical experiences measured by the CLEQ or the number of logged patients. NBME scores were weakly correlated with OSCEs scores (ɸ 0.20). Conclusions: The study findings raised uncertainties about the suitability of using NBME in the clerkship assessment program in the United Arab Emirates.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Does performance on United States national board of medical examiners reflect student clinical experiences in United Arab Emirates?

Bakoush¹,

Dhanhani²,

Al-Shamsi³

et al. 2019

MedEdPublish

View full text Add to dashboard Cite

show abstract

“…3 There is also early evidence relating poor performance on NBME subject examinations with an increased risk for failing USMLE step 3. 4 The End of Rotation examinations are just being incorporated into PA education and have not yet been characterized for reliability, nor validated against important outcomes such as program pass rates or performance on the Physician Assistant National Certification Examination (PANCE). However, PA programs would benefit from access to standardized subject examinations that meet the reliability and validity standards expected of "moderate-stakes" summative assessment tools.…”

Section: Introductionmentioning

confidence: 99%

Reliability and Validity of PAEA End of Rotation™ Examination Scores for Predicting Performance on the Physician Assistant National Certification Examination

Hegmann

Roscoe

Statler

2015

Journal of Physician Assistant Education

View full text Add to dashboard Cite

show abstract

“…Previous studies suggest a strong correlation between National Board of Medical Examiners (NBME) subject examinations and subsequent United States Medical Licensing Examination (USMLE) scores. [1][2][3] Thus, student preparation and performance on gateway NBME subject examinations can potentially provide a foundation for future successful licensing examination performance.…”

mentioning

confidence: 99%

fmCASES National Examination as a Pretest in a Family Medicine Clerkship

Nguyen

Servey

Scott

2018

Fam Med

Self Cite

View full text Add to dashboard Cite

Background and Objectives: Pretests have been shown to contribute to improved performance on standardized tests by serving to facilitate development of individualized study plans. fmCASES is an existing validated examination used widely in family medicine clerkships throughout the country. Our study aimed to determine if implementation of the fmCASES National Examination as a pretest decreased overall failure rates on the end-of-clerkship National Board of Medical Examiners (NBME) subject examination, and to assess if fmCASES pretest scores correlate with student NBME scores. Methods: One hundred seventy-one and 160 clerkship medical students in different class years at a single institution served as the control and intervention groups, respectively. The intervention group took the fmCASES National Examination as a pretest at the beginning of the clerkship and received educational prescriptions based on the results. Chi-square analysis, Pearson correlation, and receiver operating curve analysis were used to evaluate the effectiveness and correlations for the intervention. Results: Students completing an fmCASES National Examination as a pretest failed the end-of-clerkship NBME exam at significantly lower rates than those students not taking the pretest. The overall failure rate for the intervention group was 8.1% compared to 17.5% for the control group (P=0.01). Higher pretest scores correlated with higher NBME examination scores (r=0.55, P<0.001). Conclusions: fmCASES National Examination is helpful as a formative assessment tool for students beginning their family medicine clerkship. This tool introduces students to course learning objectives, assists them in identifying content areas most in need of study, and can be used to help students design individualized study plans.

show abstract

Is Poor Performance on NBME Clinical Subject Examinations Associated With a Failing Score on the USMLE Step 3 Examination?

Abstract: These findings suggest that individual schools could benefit from a review of subject exam performance to develop and validate their own criteria for identifying students at risk for failing Step 3.

Cited by 18 publications

References 6 publications

Does performance on United States national board of medical examiners reflect student clinical experiences in United Arab Emirates?

Does performance on United States national board of medical examiners reflect student clinical experiences in United Arab Emirates?

Reliability and Validity of PAEA End of Rotation™ Examination Scores for Predicting Performance on the Physician Assistant National Certification Examination

fmCASES National Examination as a Pretest in a Family Medicine Clerkship

Contact Info

Product

Resources

About