The Development and Implementation of New Assessment Tools for the Surgical Clerkship Rotation

Abstract

Innovation: We developed two new rubrics with explicit behavioural anchors to assess students in the Queen's undergraduate medical education (UGME) surgery clerkship rotation. These rotation rubrics, complemented by a new ambulatory clinic encounter card, improved the quality, consistency, and timeliness of feedback for clerks from faculty preceptors. This innovation was introduced during a comprehensive workplace-based assessment redesign being undertaken in the Department of Surgery as part of the transition to a postgraduate competency-based medical education (CBME) system for postgraduate education (PGME). The core UGME working group, comprised of a faculty surgeon, assessment consultant, and a surgical resident, selected terminology and designed the tool visual structure to be similar to the new postgraduate assessment tools, since most preceptors supervise learners in both programs. This consistency enhanced buy-in from faculty and ensured a smooth transition to the use of the new UGME tools. Development: The new assessment process was developed and piloted in three phases: (1) development of an assessment system based on rubrics with explicit behavioural descriptors as the key assessment tools; (2) implementation of a pilot study to establish the acceptability and feasibility of the use of these rubrics, with iterative revisions based on stakeholder feedback; and (3) development of a validity argument for the use of these assessment tools. The latter is scheduled for 2018. Outcomes: The use of these rotation behaviour-anchored rubrics and corresponding ambulatory clinic encounter card has greatly improved the mid-and final-rotation feedback provided to students on the Surgery Clerkship. The concrete, descriptive information provided by the rubrics allows the course director to provide specific feedback during rotation exit meetings. The course director has the ability to clearly articulate to students the areas where they have met (or exceeded) the expected level of competency, as well as areas which require additional attention.