There is a need for valid methods to assess the readiness for clinical practice of medical graduates. This study evaluates the validity of Utrecht Hamburg Trainee Responsibility for Unfamiliar Situations Test (UHTRUST), an authentic simulation procedure to assess whether medical trainees are ready to be entrusted with unfamiliar clinical tasks near the highest level of Miller's pyramid. This assessment, in which candidates were judged by clinicians, nurses and standardized patients, addresses the question: can this trainee be trusted with unfamiliar clinical tasks? The aim of this paper is to provide a validity argument for this assessment procedure. We collected data from various sources during preparation and administration of a UHTRUST-assessment. In total, 60 candidates (30 from the Netherlands and 30 from Germany) participated. To provide a validity argument for the UHTRUST-assessment, we followed Kane's argument-based approach for validation. All available data were used to design a coherent and plausible argument. Considerable data was collected during the development of the assessment procedure. In addition, a generalizability study was conducted to evaluate the reliability of the scores given by assessors and to determine the proportion of variance accounted by candidates and assessors. It was found that most of Kane's validity assumptions were defendable with accurate and often parallel lines of backing. UHTRUST can be used to compare the readiness for clinical practice of medical graduates. Further exploration of the procedures for entrustment decisions is recommended.

PurposeThe transition from undergraduate to postgraduate training can be facilitated by offering electives that focus on increased patient care responsibilities. This transitional year model in the Netherlands has recently been expanded to offer packages of electives geared to specific residencies and was called “dedicated transitional year” (DTY). At University Medical Center Utrecht, an entrustable professional activity (EPA)-based multidisciplinary DTY in acute care (DTY-AC), rooted in self-determination theory (SDT), has been implemented. The current study aimed to understand strengths and challenges regarding the implementation of this specific DTY.MethodsAn explorative qualitative study among students, graduates, and faculty was conducted using an appreciative inquiry methodological approach. We gathered first-hand accounts of experiences with the DTY-AC in focus groups and interviews with students and interviews with graduates, supervisors, and mentors. Transcripts were analyzed with a directed content analysis approach.ResultsParticipants found the DTY-AC to focus learning, offering coherence by clear learning objectives, aligned assessment, and teaching sessions and offering a congenial learning community. However, EPAs were not the focal point of workplace assessment and evaluation. Providing sufficient hands-on student engagement in actual acute care situations was another challenge.ConclusionThe concept of the thematic DTY is embraced, and it seems to help in meeting the SDT needs. Enhancing delivery in the workplace by improving formal implementation with information and faculty development, expanding EPA-focused workplace assessment, and extending hands-on experience of students could further unlock the potential of this final medical school year design. Our lessons learned may help in the development and implementation of similar programs, other models of DTYs, and final-year redesigns.

Background Medical schools seek the best curricular designs for the transition to postgraduate education, such as the Dutch elective-based final, ‘transitional’ year. Most Dutch graduates work a mean of three years as a physician-not-in-training (PNIT) before entering residency training. To ease the transition to selected specialties and to decrease the duration of the PNIT period, UMC Utrecht introduced an optional, thematic variant of the usual transitional year, that enables the development of theme-specific competencies, in addition to physicians’ general competencies. Methods We introduced an optional transitional year for interested students around the theme of acute care, called the Acute Care Transitional Year (ACTY). This study aimed to evaluate the ACTY by judging whether graduates meet postgraduate acute care expectations, indicating enhanced learning and preparation for practice. In a comprehensive assessment of acute care knowledge, clinical reasoning, skills, and performance in simulations, we collected data from ACTY students, non-ACTY students interested in acute care, and PNITs with approximately six months of acute care experience. Results ACTY graduates outperformed non-ACTY graduates on skills and simulations, and had higher odds of coming up to the expectations faculty have of a PNIT, as determined by global ratings. PNITs did better on simulations than ACTY graduates. Discussion ACTY graduates show better resemblance to PNITs than non-ACTY graduates, suggesting better preparation for postgraduate acute care challenges. Conclusion Transitional years, offering multidisciplinary perspectives on a certain theme, can enhance learning and preparedness for entering residency.