Reconceptualizing Evaluator Roles

Abstract

The current evaluation literature tends to conceptualize evaluator roles as a single, overarching orientation toward an evaluation, an orientation largely driven by evaluation methods, models, or stakeholder orientations. Roles identified range from a social transformer or a neutral social scientist to that of an educator or even a power merchant. We argue that these single, broadly construed role orientations do not reflect the multiple roles evaluators actually assume as they complete the activities encompassing an external evaluation. In contrast to the current literature, this article suggests that typical evaluation activities create functional demands on evaluators, and that evaluators respond to these demands through a limited number of specified evaluator roles. This depiction of a set of specific multiple evaluator roles, generated in response to particular evaluation activities and their associated demands, has implications regarding how evaluation is conceptualized, practiced, and studied. This article concludes with a discussion of these implications.

Evaluating Research beyond Scientific ImpactHow to Include Criteria for Productive Interactions and Impact on Practice and Society

“…However, evaluation beyond scientific impact is generally confronted with problems regarding the way scientific and nonscientific reviewers are selected and whether or not they are sufficiently competent (e. g., Daschkeit 2007, Skolits et al 2009). Furthermore, shortcomings in the extent, availability and quality of data (e.g., Uriarte et al 2007, Spaapen and Van Drooge 2011, Bell et al 2011 were extensively discussed in the literature and interviews, thus becoming a point of focus in our further investigation.…”

Understanding Evaluation Influence Within Public Sector Partnerships

“…Therefore, it is important that the evaluator and their role are captured in the model ( Figure 1). Skolits, Morrow, and Burr (2009), however, suggest that the demands of evaluation require evaluators to adopt a variety of roles during an evaluation. This notion suggests that it is not only the evaluator role that is important; evaluator skills and expertise are also likely to be important.…”

Beyond being an evaluator: The multiplicity of roles of the internal evaluator

“…According to Skolits, Morrow, and Burr (2009), descriptions of evaluator roles in the existing literature are in many cases not sufficiently delineated or conceptualized. Chelimsky (2001) 21ST CENTURY that the roles and responsibilities of the internal evaluators in the organizations ought to be pragmatically clarified.…”