<i>Policy Studies Yearbook Annual Review</i> 2022–23: Note from the editor and call for papers

Norman, Emma R.

doi:10.1111/polp.12545

Cited by 2 publications

(1 citation statement)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Relatedly, studies conducting ex-ante policy assessment bene t from a careful aggregation of existing research to map a complex system (Freebairn et al, 2016). Even reviews of policy research -such as the Policy Studies Yearbook or Theories of the Policy Process -involve critical appraisal of evidence (Norman, 2023;Weible & Sabatier, 2018). Methods for evidence synthesis have, therefore, received much attention from policymakers, analysts, and researchers alike.…”

Section: Introductionmentioning

confidence: 99%

A semi-automated approach to policy-relevant evidence synthesis: Combining natural language processing, causal mapping, and graph analytics for public policy

Hooper,

Goyal,

Blok

et al. 2023

Preprint

View full text Add to dashboard Cite

Although causal evidence synthesis is critical for the policy sciences – whether it be analysis for policy or analysis of policy – its repeatable, systematic, and transparent execution remains challenging due to the growing volume, variety, and velocity of policy-relevant evidence generation as well as the complex web of relationships within which policies are usually situated. To address these shortcomings, we developed a novel, semi-automated approach to synthesizing causal evidence from policy-relevant documents. Specifically, we propose the use of natural language processing (NLP) for the extraction of causal evidence and subsequent homogenization or normalization of the varied text, causal mapping for the collation, visualization, and summarization of complex interdependencies within the policy system, and graph analytics for further investigation of the structure and dynamics of the causal map. We illustrate this approach by applying it to a collection of 28 articles on the emissions trading scheme (ETS), a policy instrument of increasing importance for climate change mitigation. In all, we find 300 variables and 284 cause-effect pairs in our input dataset (consisting of 4524 sentences), which are reduced to 70 unique variables and 119 cause-effect pairs after normalization. We create a causal map depicting these and analyze it subsequently to obtain systemic perspective as well as policy-relevant insight on the ETS that is broadly consistent with select manually conducted, previous meta-reviews of the policy instrument. We conclude that, despite its present limitations, this approach can help synthesize causal evidence for policy analysis, policymaking, and policy research.

show abstract

Section: Introductionmentioning

confidence: 99%

A semi-automated approach to policy-relevant evidence synthesis: Combining natural language processing, causal mapping, and graph analytics for public policy

Hooper,

Goyal,

Blok

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

A semi-automated approach to policy-relevant evidence synthesis: combining natural language processing, causal mapping, and graph analytics for public policy

Hooper,

Goyal,

Blok

et al. 2024

Policy Sci

View full text Add to dashboard Cite

Although causal evidence synthesis is critical for the policy sciences—whether it be analysis for policy or analysis of policy—its repeatable, systematic, and transparent execution remains challenging due to the growing volume, variety, and velocity of policy-relevant evidence generation as well as the complex web of relationships within which policies are usually situated. To address these shortcomings, we develop a novel, semi-automated approach to synthesizing causal evidence from policy-relevant documents. Specifically, we propose the use of natural language processing (NLP) for the extraction of causal evidence and subsequent homogenization of the text; causal mapping for the collation, visualization, and summarization of complex interdependencies within the policy system; and graph analytics for further investigation of the structure and dynamics of the causal map. We illustrate this approach by applying it to a collection of 28 articles on the emissions trading scheme (ETS), a policy instrument of increasing importance for climate change mitigation. In all, we find 300 variables and 284 cause-effect pairs in our input dataset (consisting of 4524 sentences), which are reduced to 70 unique variables and 119 cause-effect pairs after homogenization. We create a causal map depicting these relationships and analyze it to demonstrate the perspectives and policy-relevant insights that can be obtained. We compare these with select manually conducted, previous meta-reviews of the policy instrument, and find them to be not only broadly consistent but also complementary. We conclude that, despite remaining limitations, this approach can help synthesize causal evidence for policy analysis, policy making, and policy research.

show abstract

Policy Studies Yearbook Annual Review 2022–23: Note from the editor and call for papers

Cited by 2 publications

References 12 publications

A semi-automated approach to policy-relevant evidence synthesis: Combining natural language processing, causal mapping, and graph analytics for public policy

A semi-automated approach to policy-relevant evidence synthesis: Combining natural language processing, causal mapping, and graph analytics for public policy

A semi-automated approach to policy-relevant evidence synthesis: combining natural language processing, causal mapping, and graph analytics for public policy

Contact Info

Product

Resources

About