Building evaluation capacity in Ontario's public health units: promising practices and strategies

Bourgeois, Isabelle; Simmons, Louise; Buetti, David

doi:10.1016/j.puhe.2018.01.031

Cited by 11 publications

(16 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, they have not been used to evaluate a research or evaluation capacity building program ( 33 ). To date, the majority of studies exploring research and evaluation capacity building projects have applied more traditional approaches such as case studies and action research ( 8 , 12 , 53 , 54 ). Lawrenz et al ( 55 ) and Grack Nelson et al ( 15 ) applied a complex adaptive systems lens to explore evaluation capacity building within a network.…”

Section: Methodsmentioning

confidence: 99%

“…Capacity building can be theorized as a catalyst that releases potential from within individuals and organizations ( 7 ). For capacity building to be effective, it requires those involved to see the benefit and be committed to the process ( 7 , 8 ). Strategies to build research, evaluation, and evidence-informed decision-making capacity in public health can target the individual, organization or system level.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Utilizing Causal Loop Diagramming to Explore a Research and Evaluation Capacity Building Partnership

Tobin

Crawford²,

Hallett³

et al. 2022

Front. Public Health

View full text Add to dashboard Cite

The capacity to engage in research, evaluation and evidence-informed decision-making supports effective public health policy and practice. Little is known about partnership-based approaches that aim to build capacity across a system or how to evaluate them. This study examines the impacts of a research and evaluation capacity building partnership called the Western Australian Sexual Health and Blood-borne Virus Applied Research and Evaluation Network (hereafter, SiREN). SiREN aims to strengthen capacity across a system of clinical and medical services and government and non-government organizations. These organizations are connected through their shared aim of preventing and managing sexually transmissible infections and blood-borne viruses. To examine SiREN, systems concepts and methods were used. Data were collected from SiREN organizational documents (n = 42), a survey tool (n = 104), in-depth interviews (n = 17), a workshop and three meetings with SiREN stakeholders and used to develop two causal loop diagrams. Findings show engagement with SiREN was influenced by a complex interplay of contextual (e.g., organizational capacity) and process (e.g., presence of trusting relationships) factors. SiREN contributed to system level changes, including increased resources for research and evaluation, the development of networks and partnerships that led to more efficient responses to emerging health issues, evidence sharing, and sustainable research and evaluation practice. The use of causal loop diagrams enabled the identification of key leverage points that SiREN can use for continuous improvement or evaluation. The focus on how contextual factors influenced SiREN's ability to create change provides valuable information for researchers, policymakers or practitioners seeking to develop a similar partnership.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Utilizing Causal Loop Diagramming to Explore a Research and Evaluation Capacity Building Partnership

Tobin

Crawford²,

Hallett³

et al. 2022

Front. Public Health

View full text Add to dashboard Cite

show abstract

“…Développé à partir d'une étude empirique au sein de l'appareil gouvernemental fédéral, le cadre conceptuel de Bourgeois et Cousins s'est montré pertinent pour l'étude des capacités en évaluation de différentes organisations comme des unités de santé publique en Ontario (Bourgeois, Hotte, Simmons, Osseni, 2016;Bourgeois, Simmons & Buetti, 2018) ou un ministère du gouvernement du Québec (Bourgeois, Whynot et Thériault, 2015). Le cadre conceptuel des capacités en évaluation a aussi été utile pour comparer les composantes organisationnelles influençant les capacités en évaluation de trois organismes liés au domaine de la santé et des services sociaux au Québec et en Ontario (Bourgeois, Whynot et Thériault, 2015).…”

Section: Tableau 1-(continué)unclassified

Caractéristiques organisationnelles qui influencent le renforcement des capacités en évaluation chez les organismes communautaires du Québec : une recension des écrits

Buetti¹,

Bourgeois

Savard

2019

CJNSER

View full text Add to dashboard Cite

Few studies have conceptualized evaluation capacity for community organizations (COs), and even fewer in the specific context of COs in Québec. The objective of this article, therefore, is twofold: 1) to identify barriers to, and opportunities for, building evaluation capacity among OCs and 2) to verify the extent to which an existing conceptual framework of organizational evaluation capacity established by Isabelle Bourgeois and J. Bradley Cousins could be useful in its current form for understanding the evaluation capacity needs of COs in Québec. We first conducted a review of the scientific literature to identify the barriers and opportunities for evaluation capacity building in OCs, and analyzed the results of the literature review against the conceptual framework. Our results point to the fact that Bourgeois and Cousins’ framework is appropriate for understanding the key factors influencing the capacity to do and to use evaluations among OCs. Additional efforts would, however, be necessary to improve the framework’s compatibility with the practices and values of COs in Québec.Les capacités en évaluation sont peu étudiées et encore moins conceptualisées en fonction du contexte particulier des organismes communautaires (OC) du Québec. Ainsi, l’objectif de cet article est double : 1) identifier chez les OC les barrières et les éléments qui facilitent le renforcement des capacités en évaluation et 2) vérifier dans quelle mesure un cadre conceptuel établi par Isabelle Bourgeois et J. Bradley Cousins pourrait s’avérer propice dans sa forme actuelle pour l’analyse des capacités en évaluation du milieu communautaire québécois. Nous avons d’abord identifié les barrières et les éléments qui facilitent le renforcement des capacités en évaluation des OC à partir d’une recherche documentaire d’articles scientifiques pertinents pour ensuite effectuer une analyse à partir du cadre conceptuel choisi. Nos résultats démontrent que le cadre conceptuel de Bourgeois et Cousins est pertinent pour répertorier les facteurs clés influençant la capacité à effectuer et à utiliser l’évaluation chez les OC. Des efforts supplémentaires seraient toutefois nécessaires pour améliorer la compatibilité du cadre conceptuel avec les pratiques et valeurs du milieu communautaire québécois.

show abstract

“…SiREN is a public health intervention that works within a system of government, research and non-government organisations that prevent and manage sexual health and blood-borne virus (SHBBV) issues (the system). SiREN uses a multi-strategic, context-specific approach [ 2 , 10 , 15 ]. Impacts achieved previously by SiREN include the development of research and evaluation knowledge, skills, and confidence; increased research and evaluation funding and the establishment of networks [ 16 ].…”

Section: Introductionmentioning

confidence: 99%

“…These include tailored support, training, resources and tools (e.g. knowledge platforms), leadership support, partnerships, and increasing access to funding [2,[8][9][10][11]. Of these strategies, partnerships that increase the proximity of researchers and knowledge users support the generation and application of practical evidence to decision making [2,[12][13][14].…”

Section: Introductionmentioning

confidence: 99%

Critical factors that affect the functioning of a research and evaluation capacity building partnership: A causal loop diagram

et al. 2022

View full text Add to dashboard Cite

Introduction Public health policy and practice is strengthened by the application of quality evidence to decision making. However, there is limited understanding of how initiatives that support the generation and use of evidence in public health are operationalised. This study examines factors that support the internal functioning of a partnership, the Western Australian Sexual Health and Blood-borne Virus Applied Research and Evaluation Network (SiREN). SiREN aims to build research and evaluation capacity and increase evidence-informed decision making in a public health context. Methods This study was informed by systems concepts. It developed a causal loop diagram, a type of qualitative system model that illustrated the factors that influence the internal operation of SiREN. The causal loop diagram was developed through an iterative and participatory process with SiREN staff and management (n = 9) via in-depth semi-structured interviews (n = 4), workshops (n = 2), and meetings (n = 6). Results Findings identified critical factors that affected the functioning of SiREN. Central to SiREN’s ability to meet its aims was its capacity to adapt within a dynamic system. Adaptation was facilitated by the flow of knowledge between SiREN and system stakeholders and the expertise of the team. SiREN demonstrated credibility and capability, supporting development of new, and strengthening existing, partnerships. This improved SiREN’s ability to be awarded new funding and enhanced its sustainability and growth. SiREN actively balanced divergent stakeholder interests to increase sustainability. Conclusion The collaborative development of the diagram facilitated a shared understanding of SiREN. Adaptability was central to SiREN achieving its aims. Monitoring the ability of public health programs to adapt to the needs of the systems in which they work is important to evaluate effectiveness. The detailed analysis of the structure of SiREN and how this affects its operation provide practical insights for those interested in establishing a similar project.

show abstract

Building evaluation capacity in Ontario's public health units: promising practices and strategies

Cited by 11 publications

References 18 publications

Utilizing Causal Loop Diagramming to Explore a Research and Evaluation Capacity Building Partnership

Utilizing Causal Loop Diagramming to Explore a Research and Evaluation Capacity Building Partnership

Caractéristiques organisationnelles qui influencent le renforcement des capacités en évaluation chez les organismes communautaires du Québec : une recension des écrits

Critical factors that affect the functioning of a research and evaluation capacity building partnership: A causal loop diagram

Contact Info

Product

Resources

About