Measuring Clinical Preparedness After Residency Training: Development of a New Instrument

Abstract

Background and Objectives: Research on preparedness for independent clinical practice typically uses surveys of residents and program directors near graduation, which can be affected by several biases. We developed a novel approach to assess new graduates more objectively using physician and staff member assessors 3 months after graduates started their first job. Methods: We conducted a literature review and key informant interviews with physicians from varying practice types and geographic regions in the United States to identify features that indicate a lack of preparedness for independent clinical practice. We then held a Clinical Preparedness Measurement Summit, engaging measurement experts and family medicine education leaders, to build consensus on key indicators of readiness for independent clinical practice and survey development strategies. The 2015 entrustable professional activities for family medicine end-of-residency training provided the framework for assessment of clinical preparedness by physician assessors. Sixteen published variables assessing interpersonal communication skills and processes of care delivery were identified for staff assessors. We assessed frequencies and compared survey findings between physician and staff assessors in 2016 to assist with survey validation. Results: The assessment of frequencies demonstrated a range of responses, supporting the instrument’s ability to distinguish readiness for independent practice of recent graduate hires. No statistical differences occurred between the physician and staff assessors for the same physician they were evaluating, indicating internal consistency. Conclusions: To learn about the possible impact of length of training, we developed a novel approach to assess preparedness for independent clinical practice of family medicine residency graduates.

A Longitudinal Assessment of Resident and New Graduate Well-Being According to Length of Training: A Report From the Length of Training Pilot in Family Medicine

“…Several papers related to this study have been published, which can provide additional background. [14][15][16][17][18][19][20] Briefly, 17 residency programs participated in LoTP: seven 3-year (3YR) civilian programs, six 4-year (4YR) civilian programs, and four Navy programs. All were in good standing with the ACGME.…”

As Time Goes by—Happy New Year!

“…Dr Carney and colleagues developed a tool to be used 3 months after new graduates start their first job. 9 This assessment tool uses information from physician colleagues and clinical staff to assess competence. It is an innovative way to evaluate clinical skills and identify areas of deficiency.…”