The relational nature of Evaluation Capacity Building: Lessons from facilitated evaluation partnerships

Buckley, Jane; Hargraves, Monica; Moorman, Leslie

doi:10.1002/ev.20445

Cited by 6 publications

(1 citation statement)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In some studies, it was noted that the absence of physical co-location was not perceived as a hindrance to team collaboration. For example, in a study conducted by Buckley and colleagues [35], a participant in a host organisation reflected: 'there was that fear that the distance would make it difficult for us to be able to do it. And I never felt the distance, we never-it The smallest class identified was a group of 28 studies (12.2%) where there were low levels of embeddedness.…”

Section: What Typologies Of Embedded Researcher Activity Can We Observe?mentioning

confidence: 99%

The implementation of embedded researchers in policy, public services, and commercial settings: a systematic evidence and gap map

Kneale,

Stansfield,

Goldman

et al. 2024

Implement Sci Commun

View full text Add to dashboard Cite

Background Embedding researchers into policy and other settings may enhance research capacity within organisations to enable them to become more research active. We aimed to generate an evidence map on evaluations of embedded researcher interventions to (i) identify where systematic reviews and primary research are needed and (ii) develop conceptual understandings of ‘embedded researchers’. We define ‘embedded researchers’ through a set of principles that incorporate elements such as the aim of activities, the types of relationships and learning involved, and the affiliations and identities adopted. Methods We included studies published across all sectors, searching fourteen databases, other web sources and two journals for evaluations published between 1991 and spring 2021. Data were extracted using a coding tool developed for this study. We identified new typologies of embedded researcher interventions through undertaking Latent Class Analysis. Results The map describes 229 evaluations spanning a variety of contexts. Our set of principles allowed us to move beyond a narrow focus on embedded researchers in name alone, towards consideration of the wide range of roles, activities, identities, and affiliations related to embedded researchers. We identified 108 different allied terms describing an embedded researcher. Embedded researcher activity spanned a continuum across lines of physical, cultural, institutional, and procedural embeddedness (from weaker to more intense forms of embeddedness) and took a range of forms that bridge or blur boundaries between academia and policy/practice. Conclusions We developed a broad map of international embedded researcher activity in a wide range of sectors. The map suggests that embedded researcher interventions occupy a broader suite of models than previously acknowledged and our findings also offer insight on the type and nature of this literature. Given the clear policy interest in this area, a better understanding of the processes involved with becoming embedded within an organisation is needed. Further work is also necessary to address the challenges of evaluating the work of embedded researchers, including consideration for which outcome measures are most appropriate, to better understand their influence.

show abstract

Section: What Typologies Of Embedded Researcher Activity Can We Observe?mentioning

confidence: 99%

The implementation of embedded researchers in policy, public services, and commercial settings: a systematic evidence and gap map

Kneale,

Stansfield,

Goldman

et al. 2024

Implement Sci Commun

View full text Add to dashboard Cite

show abstract

Relational Systems Evaluation rubrics as tools for building and measuring evaluation capacity

Urban,

Postlewaite,

Davis

et al. 2024

New Drctns Evaluation

View full text Add to dashboard Cite

Evaluation capacity building (ECB) is still an emerging area of study in the field of evaluation. The purpose of ECB is to assist program practitioners with implementing higher‐quality evaluation; however, we need better tools and resources to effectively assess ECB efforts. Existing measures typically depend on self‐report as opposed to assessing the artifacts of ECB training. Among the few non‐self‐report tools that support the assessment of ECB efforts are Relational Systems Evaluation rubrics designed to evaluate logic models, pathway models, and evaluation plans. These rubrics were first developed and tested several years ago. The purpose of the current study is to update the Relational Systems Evaluation rubrics to reflect current ECB knowledge. The updated rubrics have good to excellent inter‐rater reliability and high internal consistency. The results of this study contribute to the ECB field by providing measurement tools for assessing the quality of ECB artifacts. The rubrics can also be used by organizations and funders who need a systematic approach for assessing (and comparing) the quality of evaluation plans and visual theory of change models (e.g., logic models).

show abstract

Hoping and Caregiving in Adversity: Ithemba Hope for Parents Study

Thomas,

Valentino,

Matabaro

2024

Int J Appl Posit Psychol

View full text Add to dashboard Cite

The relational nature of Evaluation Capacity Building: Lessons from facilitated evaluation partnerships

Cited by 6 publications

References 21 publications

The implementation of embedded researchers in policy, public services, and commercial settings: a systematic evidence and gap map

The implementation of embedded researchers in policy, public services, and commercial settings: a systematic evidence and gap map

Relational Systems Evaluation rubrics as tools for building and measuring evaluation capacity

Hoping and Caregiving in Adversity: Ithemba Hope for Parents Study

Contact Info

Product

Resources

About