Measuring Fidelity to Evidence-Based Practices: Psychometrics

Ruud, Torleif; Drake, Robert E.; Bond, Gary R.

doi:10.1007/s10488-020-01074-7

Cited by 5 publications

(3 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Without reliable and valid measures, decisions using fidelity data cannot be made with a great deal of confidence. In sum, reliable and valid measures are essential to their use (Ruud et al, 2020 ).…”

Section: Gaps and Challengesmentioning

confidence: 99%

The Case for Assessing and Reporting on Facilitator Fidelity: Introducing the Fidelity of Implementation in Parenting Programs Guideline

Martin,

Shenderovich,

Caron

et al. 2023

Glob Implement Res Appl

View full text Add to dashboard Cite

The sizeable body of evidence indicating that parenting programs have a positive impact on children and families highlights the potential public health benefits of their implementation on a large scale. Despite evidence and global attention, beyond the highly controlled delivery of parenting programs via randomized trials, little is known about program effectiveness or how to explain the poorer results commonly observed when implemented in community settings. Researchers, practitioners, and policymakers must work together to identify what is needed to spur adoption and sustainment of evidence-based parenting programs in real-world service systems and how to enhance program effectiveness when delivered via these systems. Collecting, analyzing, and using facilitator fidelity data is an important frontier through which researchers and practitioners can contribute. In this commentary, we outline the value of assessing facilitator fidelity and utilizing the data generated from these assessments; describe gaps in research, knowledge, and practice; and recommend directions for research and practice. In making recommendations, we describe a collaborative process to develop a preliminary guideline—the Fidelity of Implementation in Parenting Programs Guideline or FIPP—to use when reporting on facilitator fidelity. Readers are invited to complete an online survey to provide comments and feedback on the first draft of the guideline.

show abstract

Section: Gaps and Challengesmentioning

confidence: 99%

The Case for Assessing and Reporting on Facilitator Fidelity: Introducing the Fidelity of Implementation in Parenting Programs Guideline

Martin,

Shenderovich,

Caron

et al. 2023

Glob Implement Res Appl

View full text Add to dashboard Cite

show abstract

“…While the need for rigour and psychometric assessment of fidelity measures continues to be highlighted, detailed examples of careful attention to psychometric qualities of fidelity scales are more and more evident in the literature. For an example, see the recent special issue on fidelity scales for evidence-based interventions in mental health [ 46 ]. The detailed approach used to develop quality measures of fidelity in the PRIDE study [ 5 ] provides another valuable example.…”

Section: Recommendationsmentioning

confidence: 99%

Fidelity is not easy! Challenges and guidelines for assessing fidelity in complex interventions

Ginsburg

Hoben

Easterbrook

et al. 2021

Trials

View full text Add to dashboard Cite

Background Fidelity in complex behavioural interventions is underexplored and few comprehensive or detailed fidelity studies report on specific procedures for monitoring fidelity. Using Bellg’s popular Treatment Fidelity model, this paper aims to increase understanding of how to practically and comprehensively assess fidelity in complex, group-level, interventions. Approach and lessons learned Drawing on our experience using a mixed methods approach to assess fidelity in the INFORM study (Improving Nursing home care through Feedback On perfoRMance data—INFORM), we report on challenges and adaptations experienced with our fidelity assessment approach and lessons learned. Six fidelity assessment challenges were identified: (1) the need to develop succinct tools to measure fidelity given tools tend to be intervention specific, (2) determining which components of fidelity (delivery, receipt, enactment) to emphasize, (3) unit of analysis considerations in group-level interventions, (4) missing data problems, (5) how to respond to and treat fidelity ‘failures’ and ‘deviations’ and lack of an overall fidelity assessment scheme, and (6) ensuring fidelity assessment doesn’t threaten internal validity. Recommendations and conclusions Six guidelines, primarily applicable to group-level studies of complex interventions, are described to help address conceptual, methodological, and practical challenges with fidelity assessment in pragmatic trials. The current study offers guidance to researchers regarding key practical, methodological, and conceptual challenges associated with assessing fidelity in pragmatic trials. Greater attention to fidelity assessment and publication of fidelity results through detailed studies such as this one is critical for improving the quality of fidelity studies and, ultimately, the utility of published trials. Trial registration ClinicalTrials.gov NCT02695836. Registered on February 24, 2016

show abstract

“…They are often manual-based and operationalized in ways that allow for the assessment of fidelity. They have tangible measurable outcomes (Ruud et al, 2020), for example, goal setting and attainment (e.g., McGuire et al, 2014), wellness management (Mueser et al, 2002), work (Drake & Bond, 2008; Kukla et al, 2019), housing (Rogers et al, 2009), interpersonal relationships (Roberts & Penn, 2009), and overcoming internalized stigma (Yanos et al, 2011). By contrast, it is less clear, as the field of psychiatric rehabilitation has expanded, what the processes and common active ingredients that support recovery are.…”

mentioning

confidence: 99%

Applying the concept of metacognition in the field of psychiatric rehabilitation: An introduction to the special issue.

Hasson‐Ohayon

Roe

Lysaker

2020

Psychiatric Rehabilitation Journal

View full text Add to dashboard Cite

Although psychiatric rehabilitation has grown dramatically over the last several decades, it remains unclear whether there are general overarching mechanisms of action. One lesser explored possibility is that psychiatric rehabilitation has its long-term effects because of its impact on sense of self. In this special issue authors use the concept of metacognition to explore the links between different forms of psychiatric rehabilitation and sense of self. Summarizing the articles in this issue and previous literature, we suggest that metacognition may offer a way to empirically study how psychiatric rehabilitation practices go beyond empowerment and skills acquisition to deeply affect the subjective experience of recovering persons. Specifically, we suggest that this work helps clarify how reflective abilities that support meaning making and termed here as "metacognition" are an essential part of wellness and recovery. We discuss how these reflective abilities and subsequent meanings emerge within an intersubjective framework emphasizing community and relatedness. Impact and ImplicationsThe term metacognition may offer a theoretical framework and an empirical method to understand and explore subjective changes in the recovery process. Papers is this special issue demonstrate the application of metacognitive perspective in different psychiatric rehabilitation contexts.

show abstract

Measuring Fidelity to Evidence-Based Practices: Psychometrics

Cited by 5 publications

References 10 publications

The Case for Assessing and Reporting on Facilitator Fidelity: Introducing the Fidelity of Implementation in Parenting Programs Guideline

The Case for Assessing and Reporting on Facilitator Fidelity: Introducing the Fidelity of Implementation in Parenting Programs Guideline

Fidelity is not easy! Challenges and guidelines for assessing fidelity in complex interventions

Applying the concept of metacognition in the field of psychiatric rehabilitation: An introduction to the special issue.

Contact Info

Product

Resources

About