Medical school achievements as predictors of residency performance

Yindra, K; Rosenfeld, Peri; Donnelly, Michael B.

doi:10.1097/00001888-198805000-00002

Cited by 19 publications

(24 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is evidence from nonpathology residency programs that strong, direct correlations exist between board performance and subsequent clinical performance among those residents at the upper or lower extremes of standardized test-scoring echelons. 11 There was a slightly lower failure rate for those residents with step 1 USMLE 2-digit scores of 81 to 89; however, US graduates at UPMC had the greatest failure rates (35.7%; 5 of 14) compared with other resident groups, especially international medical graduates (16.7%; 3 of 18). In our pathology program, 24% of the international medical graduates had at least 2 years of previous pathology training, which is likely a confounding factor that partially explains the lower ABP failure rates for residents with scores of 81 to 89.…”

Section: Discussionmentioning

confidence: 86%

United States Medical Licensing Examination Step 1 Two-Digit Score: A Correlation With the American Board of Pathology First-Time Test Taker Pass/Fail Rate at the University of Pittsburgh Medical Center

Picarsic

Raval

Macpherson

2011

Archives of Pathology &Amp; Laboratory Medicine

View full text Add to dashboard Cite

N Context.-Factors that correlate with success or failure on the American Board of Pathology (ABP) examination are not known. Other medical residency programs have shown that standardized test scores correlate with specialty board examination scores; however, data from pathology programs are lacking.Objective.-To investigate whether the 2-digit score on step 1 of the United States Medical Licensing Examination (USMLE) was correlated with ABP examination performance at a large university pathology program.Design.-Nine years of data (2001)(2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009)) from pathology residents (n = 72) at the University of Pittsburgh Medical Center (UPMC, Pittsburgh, Pennsylvania) was collected from existing files and deidentified.Step 1 USMLE 2-digit scores and ABP failure rates for first-time test takers were compared. Results are reported as the percentage of residents who failed either the anatomic pathology or clinical pathology part of the ABP examination in cohorts by their USMLE 2-digit score (#80, 81-85, 86-89, $90).Results.-The rolling 5-year (2005-2009) ABP average failure rate for first-time test takers of the anatomic pathology examination was 3.1% % (UPMC) and 14.1% % (nationally); in clinical pathology, it was 13.8% % (UPMC) and 23.6% % (nationally). At UPMC, no resident failed the anatomic pathology or clinical pathology parts of the ABP examination if his or her 2-digit USMLE step 1 score was 90 or more across 9 years of training (2001)(2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009).Conclusions.-In the UPMC pathology program, 2-digit scores on USMLE step 1 of 90 or more and 80 or less were strong measures of ABP first-time pass/failure rates, whereas scores of 81 to 89 were less-accurate measures. The USMLE step 1 score is one of many criteria that can be used for screening applicants for a pathology residency program.

show abstract

Section: Discussionmentioning

confidence: 86%

United States Medical Licensing Examination Step 1 Two-Digit Score: A Correlation With the American Board of Pathology First-Time Test Taker Pass/Fail Rate at the University of Pittsburgh Medical Center

Picarsic

Raval

Macpherson

2011

Archives of Pathology &Amp; Laboratory Medicine

View full text Add to dashboard Cite

show abstract

“…There is also some evidence that pooling data, as we did, generated by residents from different disciplines may distort the relationship of data. 4,21 Also the nature of the data generated by both the ITER and the program directors' survey may, in part, account for the weak relationship. 2,22 For example, ratings on the ITER and the resident directors' survey ranged primarily between the middle and upper ends limiting the variance, ultimately attenuating the strength of the correlations.…”

Section: Discussionmentioning

confidence: 99%

“…1 Because of the perceived continuity of training that extends from one level to the other, 2 assessing the performance of medical school graduates during residency has received considerable attention. To assess postgraduate performance researchers have employed unidimensional [3][4][5] and multidimensional rating forms 6-13 that tend to measure clinical and professional or interpersonal dimensions. [7][8][9][10][11][12] Correlations between undergraduate measures of knowledge and postgraduate performance tend to be low.…”

mentioning

confidence: 99%

“…[7][8][9][10][11][12] Correlations between undergraduate measures of knowledge and postgraduate performance tend to be low. 3,4,6,11,14 Although the association between measures of clinical performance at the undergraduate level and postgraduate performance appears Correspondence may be sent to Wayne Woloschuk, PhD, Room G701B, Health Sciences Centre, Faculty of Medicine, University of Calgary, Calgary, Alberta, Canada T2N 4N1. E-mail: woloschu@ucalgary.ca more promising, 6,15 low correlations between the two have also been reported.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Is Undergraduate Performance Predictive of Postgraduate Performance?

Woloschuk

McLaughlin

Wright

2010

Teaching and Learning in Medicine

View full text Add to dashboard Cite

show abstract

“…1 Programs use many sources of information to make ranking decisions, such as course grades, test scores, clerkship evaluations, awards, personal achievements, personal statements, and personal characteristics. [2][3][4][5][6][7] There is reason to believe that noncognitive factors play at least as important a role in determining success in residency as do cognitive factors, and much of the information on these noncognitive factors is obtained from the interview process. 4,[8][9][10][11][12] To reduce the burden of selection, however, many programs do not interview all applicants.…”

mentioning

confidence: 99%

Evaluation of a Structured Application Assessment Instrument for Assessing Applications to Canadian Postgraduate Training Programs in Emergency Medicine

Bandıera

Regehr

2003

Academic Emergency Medicine

View full text Add to dashboard Cite

Objective: To determine the interrater reliability and predictive validity of a structured instrument for assessing applications submitted to a Fellow of the Royal College of Physicians of Canada (FRCP) emergency medicine residency program. Methods: An application assessment instrument was derived based on faculty and resident input, institutional and national documents, and previous protocols. The instrument provided a score based on objective anchors for each of four application components. Three assessors were introduced to the instrument in a detailed tutorial session. Assessors were given five applications to score and results were compared for understanding of the scoring principles. The instrument was used in a developmental pilot to assess the 2001 cohort of applications and revised again. Applications for the 2002 study cohort were submitted through a central application service. Assessors used the instrument to score each application independently. Interrater reliability was determined by calculating a two-way mixed-effect Cronbach's alpha. Results: Forty applications were received for the year 2002. Thirty-eight application packages were complete and data collection was complete for all 38. The single-rater reliabilities for the curriculum vitae, personal letter, transcript, reference letters, and overall package were 0.73, 0.52, 0.64, 0.61, and 0.72, respectively. The three-rater reliabilities for the components were 0.89, 0.77, 0.84, and 0.82, respectively. The three-rater reliability of the overall application score was 0.89. Conclusions: Three-rater reliabilities for each component and the entire application package were high. Multiple assessors are required to generate acceptable reliabilities. Using strict design and implementation principles can lead to a reliable instrument for assessing complex application packages.

show abstract

Medical school achievements as predictors of residency performance

Cited by 19 publications

References 0 publications

United States Medical Licensing Examination Step 1 Two-Digit Score: A Correlation With the American Board of Pathology First-Time Test Taker Pass/Fail Rate at the University of Pittsburgh Medical Center

United States Medical Licensing Examination Step 1 Two-Digit Score: A Correlation With the American Board of Pathology First-Time Test Taker Pass/Fail Rate at the University of Pittsburgh Medical Center

Is Undergraduate Performance Predictive of Postgraduate Performance?

Evaluation of a Structured Application Assessment Instrument for Assessing Applications to Canadian Postgraduate Training Programs in Emergency Medicine

Contact Info

Product

Resources

About