Competency-Based Medical Education in a Norm-Referenced World: A Root Cause Analysis of Challenges to the Competency-Based Paradigm in Medical School

Abstract

Competency-based medical education (CBME) requires a criterion-referenced approach to assessment. However, despite best efforts to advance CBME, there remains an implicit, and at times, explicit, demand for norm-referencing, particularly at the junction of undergraduate medical education (UME) and graduate medical education (GME). In this manuscript, the authors perform a root cause analysis to determine the underlying reasons for continued norm-referencing in the context of the movement toward CBME. The root cause analysis consisted of 2 processes: (1) identification of potential causes and effects organized into a fishbone diagram and (2) identification of the 5 whys. The fishbone diagram identified 2 primary drivers: the false notion that measures such as grades are truly objective and the importance of different incentives for different key constituents. From these drivers, the importance of norm-referencing for residency selection was identified as a critical component. Exploration of the 5 whys further detailed the reasons for continuation of norm-referenced grading to facilitate selection, including the need for efficient screening in residency selection, dependence upon rank-order lists, perception that there is a best outcome to the match, lack of trust between residency programs and medical schools, and inadequate resources to support progression of trainees. Based on these findings, the authors argue that the implied purpose of assessment in UME is primarily stratification for residency selection. Because stratification requires comparison, a norm-referenced approach is needed. To advance CBME, the authors recommend reconsideration of the approach to assessment in UME to maintain the purpose of selection while also advancing the purpose of rendering a competency decision. Changing the approach will require a collaboration between national organizations, accrediting bodies, GME programs, UME programs, students, and patients/societies. Details are provided regarding the specific approaches required of each key constituent group.

Precision Education: The Future of Lifelong Learning in Medicine

“…Effective coaching is a partnership fostering individual agency in learning that nurtures a growth mindset and strategies to build coaching capacity. As educators have developed traditional coaching programs, a practical challenge has been that it is resource intensive 25 . PE may address this by taking advantage of emerging technologies, such as virtual platforms and augmented intelligence that scale coaching programs, including in settings with fewer resources 26,27 …”

Defining competencies in robotic thyroidectomy: development of a model assessing an expert operator’s intraoperative performance skills and cognitive strategies

“…Recently, the educational paradigm in surgery has changed from the traditional apprenticeship model to competency-based medical education, which emphasizes the acquisition of standard technical and cognitive proficiency for performing surgery safely and effectively ( 1 - 3 ). To incorporate intraoperative decision-making ability into the standard surgical training curriculum, many studies have attempted to identify cognitive components associated with the success of various types of surgery, such as conventional open thyroidectomy, management of trauma patients, laparoscopic transabdominal adrenalectomy, and flexible pharyngo-laryngoscopy ( 3 - 6 ).…”