A Narrative Review of the Evidence Supporting Factors Used by Residency Program Directors to Select Applicants for Interviews

Abstract

Background Residency applicants feel increasing pressure to maximize their chances of successfully matching into the program of their choice, and are applying to more programs than ever before. Objective In this narrative review, we examined the most common and highly rated factors used to select applicants for interviews. We also examined the literature surrounding those factors to illuminate the advantages and disadvantages of using them as differentiating elements in interviewee selection. Methods Using the 2018 NRMP Program Director Survey as a framework, we examined the last 10 years of literature to ascertain how residency directors are using these common factors to grant residency interviews, and whether these factors are predictive of success in residency. Results Residency program directors identified 12 factors that contribute substantially to the decision to invite applicants for interviews. Although United States Medical Licensing Examination (USMLE) Step 1 is often used as a comparative factor, most studies do not demonstrate its predictive value for resident performance, except in the case of test failure. We also found that structured letters of recommendation from within a specialty carry increased benefit when compared with generic letters. Failing USMLE Step 1 or 2 and unprofessional behavior predicted lower performance in residency. Conclusions We found that the evidence basis for the factors most commonly used by residency directors is decidedly mixed in terms of predicting success in residency and beyond. Given these limitations, program directors should be skeptical of making summative decisions based on any one factor.

The Impact of COVID-19 on Medical Education

“…As many medical students now will miss out on the valuable experiences of presentations, clinical rotations, and collaborative experiences -standards which helped previous generations become future doctors -the question arises of how students will evolve and integrate themselves into the medical community. When considering the reasons why conference presentations and extracurricular activities become so central to residency applications, it is important to recall what they actually represent for each student [1]. Therefore, we must consider how medical students can develop and demonstrate skills such as knowledge, determination, and collaboration and best prepare for the careers ahead of them in the face of these recent changes.…”

Investigation of the Admission Profile of Medical Residency in Brazil: An Observational Study

“…Although Step 1 of the United States Medical Licensing Examination (USMLE) is often used as a comparative factor, most studies do not demonstrate its predictive value for resident performance, except in the event of a test failure. It has also been found that structured letters of recommendation for a specialty have increased benefits when compared to generic letters (Hartman, Lefebvre, & Manthey, 2019).…”

Reimagining Residency Selection: Part 3—A Practical Guide to Ranking Applicants in the Post-COVID-19 Era

“…[14][15][16] The predictive ability of various application data or summative scoring rubrics on future resident performance has been mixed. 14,15,17,18 Previously used scoring rubrics may need to be restructured or reweighted, by potentially incorporating diversity as a metric to mitigate existing structural bias within medicine. Expanding screening tools to capture a broader spectrum of candidate aptitudes may help to create more diverse classes of residents.…”