Confronting ideology and self‐interest: Avoiding misuse of evaluation

Abstract

This chapter illustrates the attempt to misuse the evaluation of a complex, large‐scale, highly visible project with many powerful stakeholders and presents the authors' suggestions for countering the misuse.

The Strength of the Methodological Warrants for the Findings of Research on Program Evaluation Use

“…To examine ''how one evaluation study tried to meet the knowledge use issue directly by involving program staff in it'' (p. 174) A narrative reflection about a study of a quality assurance system developed at a health maintenance organization for use at a community mental health center Vroom, Colombo, and Nahan (1994) Labor…”

Commentary: Can This Evaluation Be Saved?

“…During these meetings, the evaluator should work with each group to ensure that the evaluation plan includes data collection and analysis regarding the context. Mowbray (1988) and Vroom, Colombo, and Nahan (1994) describe the importance of meeting regularly with stakeholders. These meetings provide the opportunity to present feedback (part of the formative evaluation) on the operations of the EAP, as well as updates on the status and challenges of the evaluation.…”

An exploratory syudy on ENADE evaluation report utilization and its impact on undergraduate accounting program performance in Brazil

“…Palumbo (1994) stated that misuse is not a single phenomenon but assumes different forms, such as the distortion or rejection of evaluation findings. Vroom, Colombo, and Nahan (1994) affirmed that "deliberate or inadvertent misuse of evaluation often arises from self-interest" (p. 49). In addition, as examples of the misuse of evaluation findings, Stevens and Dial (1994) included "using the results to further a political career, or to end one; using results to reward or punish staff; or not distributing findings to other stakeholders" (p. 7).…”