Sunshine, Scrutiny, and Spending Review in Canada, Trudeau to Trudeau: From Program Evaluation and Policy to Commitment and Results

Abstract

This review surveys experience with evaluation practices in the Government of Canada since the mid-1960s, particularly with respect to spending reviews, concluding that there is little reason to expect any direct link from ongoing evaluation practices to Cabinet decisions. The renewed commitment to evidence-based decision-making announced by the new Liberal government is unlikely to change this conclusion. The introduction of Deliverology as a support function centered in the Privy Council Office shifts attention from policy formation to implementation and program delivery, with important emphasis on innovation and adaptation. But the crucial challenge still rests in achieving greater public access to information, and greater inclusiveness in decision processes. Résumé:Cet article fait état du rôle de l’évaluation au niveau du Gouvernement du Canada depuis le milieu des années 1960. En particulier, il analyse le lien entre l’évaluation et les exercices de révision budgétaire, concluant qu’il a peu de raison d’attendre de l’évaluation qu’elle ait une influence directe sur les décisions du Cabinet. L’engagement renouvelé du nouveau gouvernement libéral à ce que les décisions soient fondées sur les connaissances ne changera probablement cette conclusion. L’introduction de la résultologie, comme une fonction en support au Bureau du Conseil Privé, détourne l’attention de la conception des politiques vers l’implantation et l’exécution des programmes, en mettant l’accent sur l’innovation et l’adaptation. L’enjeu principal reste toutefois le même, de réussir à améliorer l’accès public à l’information, et à être plus inclusif dans les processus décisionnels.

“Deliverology” and Evaluation: A Tale of Two Worlds

“…(Barber et al, 2013, p. 17) The academic literature in evaluation, public administration, 2 and political sci ence is remarkably absent from Barber's reference lists. Conversely, references to "deliverology" per se are rare in evaluation and policy studies, where there is a vast literature grounded in scientific inquiry and practitioners' experiences aft er four decades of institutionalization and professionalization of evaluation in Ca nadian public administration (Canada, Treasury Board Secretariat, 2013-2014Cummings & Gauthier, 2016;Dobell & Zussman, 2018;Jacob, 2006). Th us, the first divergence between evaluation and deliverology is rooted in their respective sources of knowledge and inspiration.…”

Expenditure Reviews and the Federal Experience: Program Evaluation and Its Contribution to Assurance Provision

“…5.2.3). The question is whether program evaluation can contribute effectively in this model, which is addressed in the next section and by Dobell and Zussman (2018). There are those, including Montague, who believe a move to greater performance measurement with a proper focus on targets can improve government-wide performance reporting (Montague, 2016).…”

“…Others in this volume comment on the limited role that program evaluation has played in expenditure reviews (Mayne, 2018;Dobell & Zussman, 2018;Robinson, 2018). However, the particular reasons for this conclusion should not go unstated.…”

A Critical Exploration of Culture in International Development Evaluation

“…(Barber et al, 2013, p. 17) The academic literature in evaluation, public administration, 2 and political sci ence is remarkably absent from Barber's reference lists. Conversely, references to "deliverology" per se are rare in evaluation and policy studies, where there is a vast literature grounded in scientific inquiry and practitioners' experiences aft er four decades of institutionalization and professionalization of evaluation in Ca nadian public administration (Canada, Treasury Board Secretariat, 2013Cummings & Gauthier, 2016;Dobell & Zussman, 2018;Jacob, 2006). Th us, the first divergence between evaluation and deliverology is rooted in their respective sources of knowledge and inspiration.…”

“…Canada School of Pub lic Service, 2016a; see also Delivery Associates, n.d.b). In Canada, at the outset of his first mandate, Justin Trudeau, as Prime Minister of Canada, turned to Barber with his storytelling approach and more supple evidence hierarchy (see Dobell & Zussman, 2018;Puttick & Ludlow, 2013;Shepherd, 2018) instead of contracting to experts in public policy and public administration for guidance in implement ing, rather than delivering, the Liberal Party of Canada's platform. It is important to note that, for Barber, evidence that a policy is working lies in achieving a set of chosen targets set by the executive level of government, whereas for evaluators and scholars, the aspirational standards are set in light of the policy goals and require the production of valid and reliable data using scientific methods to determine the policy's relevance, eff ectiveness, efficiency, impact, and sustainability in achieving positive intended outcomes.…”