Evaluation and the Social Construction of Impacts

Abstract

The central questions of this article are when, how and what do governmental agencies learn from evaluations. A structural constructivist theoretical framework is developed and applied to two case studies, both of which take a report by the Dutch Court of Audit (CoA) as a starting point. A reconstruction is made of the intra-and interorganizational processes through which the impacts of these evaluations were socially constructed. It appears that an evaluation has hardly any direct effect that can be unequivocally ascribed to it. Rather, evaluations seem to support or counteract debates, tendencies and options already present (or 'under construction') in the interaction among the actors involved. Using a structural constructivist theoretical framework we identify mechanisms and conditions that enhance forms of learning processes.This article concludes with some hypotheses about the genesis of evaluation impact. Evaluation

Auditee Strategies: An Investigation of Auditees’ Reactions to the Norwegian State Audit Institution’s Performance Audits

“…Still they questioned whether the changes necessarily represented improvements. Other researchers have focused on learning processes and success factors associated with the performance audit, stressing the importance of the compatibility of the opinions of the auditor and the auditee (De Vries et al 2000; Van der Meer 1999). Lapsley and Pong (2000) based the assessment of impact on the opinion of the auditors themselves.…”

Hard and soft projects: a framework for analysis

“…However quantitative measurement can not analyse all aspects of reality, as ''quantity does not capture issues of meaning, attitude, or morale'' [48, p. 22]. Furthermore, in complex situations the measurement of a few isolated variables may not provide an adequate description of the outcomes being assessed [49,50].…”

Performance audit and the importance of the public debate

“…Evaluation researchers are preoccupied with the question of impact and the utilization of evaluation results, including performance audit (van der Meer, 1999). There are calls for more evidence on the subject (Lonsdale et al, 2011).…”