Making values explicit in evaluation practice

Abstract

Values play a fundamental role in the evaluation process; however, evaluators and evaluation training have tended to focus on research methodology. Much less emphasis has been placed on explicit attention to values and valuing, and the steps necessary to justify those aspects of evaluation conclusions. In this article, we argue that to improve evaluation practice, we need to make values an explicit part of the evaluation process. Research done in other disciplines can offer assistance towards this end. We first provide a general discussion of basic practical applications of value theories. Then, we offer an example for how a particular individual values theory, Schwartz’s Theory of Basic Human Values, can inform our work and encourage further exploration of approaches for incorporating value theories into evaluation practice.

Performance measurement, evaluation and accountability in public philanthropic foundations

“…While the philanthropic literature discusses the privilege of donor control, the privilege of evaluation is a new finding in a foundation context. Gullickson and Hannum (2019) critique the dominance of evaluation processes in the literature, with less emphasis on the values that inform evaluation conclusions. While diversity and racial equity were not mentioned by participants in this study, Dean-Coffey (2018) emphasises in the context of US philanthropic foundations that data and evaluation have a powerful future role to play in the equitable distribution of foundations’ knowledge and funds.…”

“…Evaluation, like accountability, is a multi-faceted concept. Definitions of evaluation from a philanthropic or nonprofit context include accessing, understanding and using evaluative information to achieve organisational goals (Rogers et al, 2019); the process of determining worth, merit or significance (Gullickson & Hannum, 2019); and activities that systematically assess and learn about a foundation’s work and go beyond reporting, monitoring and due diligence practices (Buteau et al, 2016). However, literature focusing on philanthropic evaluation including those organisations that are intermediaries (Benjamin, 2010b) recognises evaluation and impact measurement to be contested issues.…”

Whose values? Decision making in a COVID-19 emergency-management scenario

“…Judgements based on values are the territory of evaluators, and values permeate organisations and programmes (Gullickson & Hannum, 2019). Rather than limiting our sphere of influence to evaluation questions, data collection, and synthesising judgements, this reflection demonstrates that our tools can also assist in real-time situations where values are enacted in decision making.…”

Developing evaluation criteria using an ethical lens

“…For evaluative judgements to be justified, the evaluator must pay attention to both evidence and values. As noted elsewhere in this journal (Gullickson & Hannum, 2019), values are relevant to all aspects of evaluation. In this article, the term ‘values’ refers explicitly to the values against which judgements are made.…”