OSCE checklists do not capture increasing levels of expertise

Abstract

These findings are consistent with the hypothesis that binary checklists may not be valid measures of increasing clinical competence.

Evaluation of the use of patient-focused simulation for student assessment in a surgery clerkship

“…The lower reliability coefficient for Data Gathering scores is consistent with the uncertainty surrounding the quality of the checklists developed for measuring history and physical examination skills in these types of tests, and the difficulty in applying these checklists objectively and reproducibly. 24,[26][27][28][29][30] We found small positive and statistically-significant relationships between performance in the surgery OSCE and faculty ratings of performance in the surgery clerkship. These findings are consistent with an early study based on five years of data that underscored the complementary nature of clerkship ratings and SP clinical skill assessments.…”

Getting to the Right Question

“…1,2 Instead, the early inclusion of the final diagnosis among early hypotheses is a better predictor of diagnostic accuracy. 3,4 This early triggering comes from pattern recognition (the consulting nephrologist) or the orderly framing and reframing of the problem (the discussant).…”

Review article: Assessment in anesthesiology education

“…Given the complexities of and interrelationships amongst some of the core competencies, subjective measures may often provide less biased, more generalizable, and appropriately valid indicators of ability. 78,79 The use of objective performance measures for evaluating some competencies (e.g., patient care) is commonplace. For OSCEs, part-task trainers, and electromechanical mannequins, checklists or key actions are typically employed.…”