AMEE Guide No. 18: Standard setting in student assessment

Abstract

Licensure, credentialling and academic institutions are seeking new innovative approaches to the assessment of professional competence. Central to these recent initiatives is the need to determine standards of performance, which separate the competent from the non-competent candidate. Setting standards for performance assessment is a relatively new area of study. Consequently, there is no one recommended approach to setting standards. The goal of this guide is to familiarize the reader with the framework, principles, key concepts and practical considerations of standard setting approaches and to enable the reader to make`educated' choices in selecting the most appropriate standard setting approach for their testing needs. Key concepts The goal of this guideTo fam iliarize th e reader with the fram ework, the principles, key concepts and practical considerations of standard setting approaches and to enable the reader to make`educated' choices in selecting the most appropriate standard setting approach for their testing needs.

An introduction to standard setting methods in dentistry

“…6 Standards may be classified as either relative (norm-referenced) or absolute (criterion-referenced). 7,8 Relative standards are expressed in terms of the performance of the cohort taking the assessment.…”

Tests, Quizzes, and Self-Assessments: How to Construct a High-Quality Examination

“…For the purposes of admission into a school or career track, defining a proportion of the group to pass may be necessary owing to limited available spots. Different methods of establishing a passing score are explained in detail in the Association for Medical Education in Europe guide number 18 [30].…”

Assessment of reliability, sensitivity, objectivity and validity of MCQ Pharmacology Exams as a potential output variable for predictive analysis

“…the smallest number of points obtained on the exam that confirms that a student met the requirements of a particular level. 31 However, the a priori quantitative standard for pharmacology exams underwent a posteriori revision after receiving the test results. The analysis of the required score thresholds for MCQ exams demonstrated that the "passed/failed" cut-off point was always at the same level.…”