Developing Case-specific Checklists for Standardized-patient—Based Assessments in Internal Medicine

Abstract

The development of case-specific checklists for SP examinations of physicians' performance has received little attention. To judge the validity of studies of physicians' performances that use SPs, the development processes for the checklists need to be more fully described to enable readers to evaluate the validity and reliability of the studies.

Evaluation of the use of patient-focused simulation for student assessment in a surgery clerkship

“…The lower reliability coefficient for Data Gathering scores is consistent with the uncertainty surrounding the quality of the checklists developed for measuring history and physical examination skills in these types of tests, and the difficulty in applying these checklists objectively and reproducibly. 24,[26][27][28][29][30] We found small positive and statistically-significant relationships between performance in the surgery OSCE and faculty ratings of performance in the surgery clerkship. These findings are consistent with an early study based on five years of data that underscored the complementary nature of clerkship ratings and SP clinical skill assessments.…”

Simulated patient programmes in Europe: Collegiality or separate development?

“…However, variance in case development and SP training are likely to lead to inconsistencies in SP case portrayal. Consistency of performance is a vital factor in ensuring the reliability of SPs in the summative assessment of medical students (Gorter et al 2000).…”

Procedures for Developing Evidence-Informed Performance Checklists for Improving Early Childhood Intervention Practices

“…Results from literature reviews by Frank (2006) and Winters et al (2009), for example, found that articles describing the development of checklists rarely included descriptions of the procedures that guided checklist development (see C. Wilson, 2013, for an exception). Most often, expert panels or consensus procedures have been used to develop checklist items (Gorter et al, 2000). Winters et al (2009), based on their review of checklists, concluded that checklist development could be improved considerably if scientific evidence was used to inform checklist indicator development.…”