Context: Although competence committees (CCs) are most often conceptualised as group decision-making bodies, policy documents forward a more ambitious vision and outline several additional roles for CCs that support the continuous quality improvement of education programmes and promote formative feedback. However, whether these functions are encompassed in the everyday work of CCs is currently unknown.Methods: This constructivist grounded theory study elaborates the range of roles taken up by CCs and illuminates the processes through which these roles are actualised. Two investigators observed 27 CC meetings (>80 hours) across seven diverse postgraduate programmes at a single Canadian institution. Following each observation, a semi-structured interview was conducted with one CC member. Data collection and analysis unfolded iteratively.
Results:In this study, CCs did much more than make summative decisions about progression and entrustment; they identified a variety of problems that arose at the levels of both the individual learner and the programme, and leveraged their knowledge of assessment data to develop solutions. The problem-solving work of CCs was enabled by the in-depth data review, synthesis and analysis work that occurred before scheduled meetings, outside protected academic or administrative time. Although this work often appeared invisible to those outside the committee, the insights gleaned from data review provided committee members with essential information about how their programme of assessment was unfolding in practice.
Conclusions:Competence committees may be an untapped resource that can support assessment for learning, local evaluation of competency-based medical education (CBME) implementation and continuous quality improvement for programmes of assessment. However, the ability of CCs to engage in this work is fragile and is currently sustained by the willingness of faculty members to devote their time and energy to it. The resourcing of CCs may have profound implications for translation of the theory of programmatic assessment and CBME into practice. 518 | PACK et Al.
| INTRODUC TI ONCompetence committees (CCs) are a recent addition to postgraduate medical education. In the literature, these small groups are most often defined as summative decision-making bodies, responsible for the review, collation and evaluation of trainee assessment data. 1-4 To date, this body of literature has been organised around two themes: (a) developing best practices and forwarding practical advice for the assemblage and operation of CCs, 5-9 and (b) understanding how the decision-making work of the CC unfolds. 1,[10][11][12][13][14] The latter literature has a strong emphasis on summative decision making, explicating how these small groups collate and interpret aggregate assessment data to inform decisions about progression and entrustment. 1,13,15,16 Given the high-stakes nature of these summative decisions, it is unsurprising that they have been subject to significant scholarly interest. However, the focus ...