A review of the American College of Surgeons accredited education institutes’ assessment practices for learners, faculty, and continuous program improvement

Abstract

Purpose Simulation is an instructional modality that offers opportunities for assessment across many domains. The American College of Surgeons created the Accredited Education Institutes (AEIs) to build a community of high-quality simulation centers focused around improving surgical education and training. The goals of this project were to identify assessment methods used by AEIs, discuss how these methods align with established assessment frameworks, identify best practices, and provide guidance on best practice implementation. Methods The authors analyzed responses regarding learner assessment, faculty assessment, and continuous program improvement from AEI accreditations surveys using deductive qualitative analysis. Results Data from ninety-six centers were reviewed. Codes for each category were organized into formal and informal themes. For learner assessment, examinations and checklists identified as the most common types of formal assessment used and oral feedback as the most common type of informal assessment. For faculty assessment, written evaluations were the most common formal type and debriefs were the most common informal type. For continuous program improvement, written evaluations were the most common formal type and oral feedback was the most frequent informal type. Discussion The goal of assessment should be to encourage learning through feedback and to ensure the attainment of educational competencies. The data revealed a variety of assessment modalities used to accomplish this goal with AEIs frequently utilizing some of the most reliable forms of assessment. We discuss how these forms of assessment can be integrated with best practices to develop assessment portfolios for learners and faculty, performance improvement reports for faculty, and assessments of clinical impact. Supplementary Information The online version contains supplementary material available at 10.1007/s44186-023-00132-6.