Teaching specification of evaluative criteria: A guide for evaluation education

Abstract

Evaluative criteria describe the attributes that define a high‐quality intervention and represent values about which intervention characteristics or results are desirable. There are many types of criteria, including those focused on intervention outcomes or impact, design and implementation, and relevance. Criteria may remain implicit and assumed in evaluation practice, yet they nonetheless direct evaluative inquiry and provide the value basis for evaluative conclusions. It is therefore important for novice evaluators to understand why criteria matter and how to thoughtfully consider which and whose criteria to use. We introduce an approach for teaching criteria specification to guide novice evaluators in considering, selecting, and articulating criteria. We introduce key concepts, outline an instructional approach, and provide a downloadable teaching activity for graduate students, undergraduates, and working professionals.

Evaluation criteria for artificial intelligence

“…Some scholars have advanced knowledge about the critical importance of criteria (Julnes, 2012;Schwandt, 2015), including the limits of what is known and how it is put into practice (Greene et al, 2011;Harman & Azzam, 2018;Ozeki et al, 2019). Others have developed resources and tools to help with criteria selection and use (Davidson, 2005; [OECD], 2018; Teasdale, Pitts et al, 2023). And, several organizations and researchers have developed evaluation criteria frameworks (OECD, 2018;Roorda & Gullickson, 2019;Teasdale, 2021).…”