An introduction to policy advocacy evaluation: The concepts, history, and literature of the field

Raynor, Jared; Coffman, Julia; Stachowiak, Sarah

doi:10.1002/ev.20478

Cited by 3 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We understand complexity as relating to the multi‐directional and less predictable nature of a given social or political change process. While most development projects exhibit some complexity, this chapter focuses on DRG projects that seek to influence multifaceted, frequently long‐term social or political change processes characterized by their non‐linearity (Raynor et al., 2021). By extension, the theories of change underpinning DRG projects often lack an established evidence base in their specific contexts.…”

Section: Overview Of Complexity Adaption and Drg Projectsmentioning

confidence: 99%

Nimble adaptation: Tailoring monitoring, evaluation, and learning methods to provide actionable data in complex environments

Serpe¹,

Ingram²,

Byom³

2022

New Drctns Evaluation

View full text Add to dashboard Cite

This chapter examines good practices in implementing effective Monitoring, Evaluation, and Learning (MEL) systems within complex international development Democracy, Human Rights, and Governance (DRG) programs, which are characterized by challenges of non‐linearity, limited evidence of theories of change, and contextual and politically contingent nature of outcomes. The chapter presents three cases of MEL systems in complex projects implemented by Pact across distinct and diverse operating contexts – Zimbabwe, Cambodia, and Somalia – to illustrate those projects’ MEL approaches that enabled continuous adaptation. The authors analyze the cases to respond to two questions: (1) What are the key elements of effective adaptive management‐focused MEL systems in complex environments? (2) What is practical guidance for designing and enabling complexity‐responsive and effective adaptive management‐focused MEL systems? The case studies illustrate three key elements: (1) Information gathering that closely links context, research, and performance data; (2) Systems for reflection that offer scheduled learning moments of varying frequency and intensity, as well as multiple feedback mechanisms; and (3) Enabling structures that promote adaptive mindsets and attitudes within project teams.

show abstract

Section: Overview Of Complexity Adaption and Drg Projectsmentioning

confidence: 99%

Nimble adaptation: Tailoring monitoring, evaluation, and learning methods to provide actionable data in complex environments

Serpe¹,

Ingram²,

Byom³

2022

New Drctns Evaluation

View full text Add to dashboard Cite

show abstract

“…One way for leaders of professional nursing associations to strengthen their influence and impact is to evaluate their policy advocacy work to measure their progress and successes. Policy advocacy evaluation is distinct from policy evaluation as it focuses on the process of assessing the policy change process, rather than the value or impact of policy (Raynor et al, 2021). While there are several challenges with evaluating advocacy such as the level of complexity, presence of multiple external factors, long time frames, shifting strategies and milestones and attribution dilemmas (Gardner & Brindis, 2017; Guthrie et al, 2005; Raynor et al, 2021), it is important as it allows association leaders to understand their areas of strength and weakness.…”

Section: Discussionmentioning

confidence: 99%

“…To strengthen the policy advocacy function of professional nursing associations, leaders should focus their attention on developing clear theories of change to align their goals, strategies and intended outcomes to assess their impact (Stachowiak, 2013). The field of policy advocacy evaluation has evolved over the decades (Raynor et al, 2021), and those leading the work of professional nursing associations can draw on a wide range of theories to support their monitoring and evaluation efforts. Ultimately, nursing associations' policy advocacy influence and impact can only be strengthened if progress is tracked, and outcomes are measured.…”

Section: Discussionmentioning

confidence: 99%

Lessons from professional nursing associations' policy advocacy responses to the COVID‐19 pandemic: An interpretive description

Chiu

Thorne

Schick‐Makaroff

et al. 2023

Journal of Advanced Nursing

View full text Add to dashboard Cite

Background Professional nursing associations across jurisdictions engaged in significant policy advocacy during the COVID‐19 pandemic to support nurses, the public and health systems. While professional nursing associations have a long history of engaging in policy advocacy, scholars have rarely critically examined this important function. Purpose The purpose of this study was twofold: (a) to examine how professional nursing associations engage in the process of policy advocacy and (b) to develop knowledge specific to policy advocacy in the context of a global pandemic. Methods This study was conducted using interpretive description. A total of eight individuals from four professional nursing associations (two local, one national and one international) participated. Data sources included semi‐structured interviews conducted between October 2021 and December 2021 and internal and external documents produced by organizations. Data collection and analysis occurred concurrently. Within‐case analysis was conducted prior to cross‐case comparisons. Findings Six key themes were developed to illustrate the lessons learned from these organizations including their organization's role in supporting a wide audience (professional nursing associations as a compass); the scope of their policy priorities (bridging the gaps between issues and solutions), the breadth of their advocacy strategies (top down, bottom up and everything in between), the factors influencing their decision‐making (looking in and looking out), their evaluation practices (focus on contribution, not attribution) and the importance of capitalizing on windows of opportunity. Conclusions This study provides insight into the nature of policy advocacy carried out by professional nursing associations. Impact The findings suggest the need for those leading this important function to think critically about their role in supporting a wide range of audiences, the breadth and depth of their policy priorities and advocacy strategies, the factors that influence their decision‐making, and the ways in which their policy advocacy work can be evaluated to move towards greater influence and impact.

show abstract

“…More recently, the evaluation field has devoted increasing attention to methodologies for assessing "contribution" rather than "attribution" (Ebrahim, 2019, pp. 229-236;Kane et al, 2021;Raynor et al, 2021). Contribution-based methodologies are more appropriate for examining social change in complex systems where it is not feasible to create an experiment with a control group, to sufficiently isolate causal mechanisms, or to establish an observable counterfactual (Lemire et al, 2012;Mayne, 2001Mayne, , 2011Mayne, , 2012Rogers, 2007Rogers, , 2009.…”

Section: With What Evidence and Methods?mentioning

confidence: 99%

Nonprofit Organizations and the Evaluation of Social Impact: A Research Program to Advance Theory and Practice

Benjamin

Ebrahim

Gugerty

2022

Nonprofit and Voluntary Sector Quarterly

View full text Add to dashboard Cite

This article proposes a research program with two goals: (a) to support nonprofit leaders to productively engage evaluation and (b) to advance a meso-level theory of nonprofit evaluation that recognizes the diverse ways nonprofits contribute to social change. Such a research program is timely, as evaluation becomes increasingly institutionalized in the sector in ways that constrain nonprofit leaders from engaging productively with evaluation to advance their social impact. This research program brings existing nonprofit scholarship into conversation with evaluation scholarship and puts forward a research agenda organized around the practical dilemmas facing nonprofit leaders as they answer four key evaluation questions: what to evaluate, for what purpose, using which criteria, and with what evidence and methods. By anchoring a research program around these four questions, we seek to reopen the possibilities for how scholars can support nonprofit leaders in engaging evaluation to enhance their social impact.

show abstract

An introduction to policy advocacy evaluation: The concepts, history, and literature of the field

Cited by 3 publications

References 5 publications

Nimble adaptation: Tailoring monitoring, evaluation, and learning methods to provide actionable data in complex environments

Nimble adaptation: Tailoring monitoring, evaluation, and learning methods to provide actionable data in complex environments

Lessons from professional nursing associations' policy advocacy responses to the COVID‐19 pandemic: An interpretive description

Nonprofit Organizations and the Evaluation of Social Impact: A Research Program to Advance Theory and Practice

Contact Info

Product

Resources

About