Relationship Between Self-Assessed Fidelity and Self-Reported Employment in the Individual Placement and Support Model of Supported Employment

Margolies, Paul J.; Humensky, Jennifer; Chiang, I-Chin; Covell, Nancy H.; Jewell, Thomas C.; Broadway-Wilson, Karen; Gregory, Raymond; Scannevin, Gary; Dixon, Lisa B.

doi:10.1176/appi.ps.201700472

Cited by 12 publications

(5 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Results from this pilot study and others (Margolies et al 2017(Margolies et al , 2018 suggest that intermediary organizations may be positioned to provide expert training and technical assistance to help programs integrate self-assessments with quality improvement activities. Programs that learn to conduct self-assessment and use the results to implement and sustain practice may demonstrate greater buy-in as they take ownership of the ongoing process.…”

Section: Discussionmentioning

confidence: 76%

See 1 more Smart Citation

Intermediary Organizations Can Support Integration of Fidelity Self-assessment and Quality Improvement

Covell

Foster²,

McGovern

et al. 2021

Glob Implement Res Appl

Self Cite

View full text Add to dashboard Cite

Fidelity scales demonstrate whether practices are delivered as intended. Typically, these assessments are conducted by independent raters, which can be expensive and difficult to resource in large systems. We piloted whether an intermediary organization could (1) train programs to conduct a self-assessment using an established reliable and valid measure, the Dual Diagnosis Capability in Mental Health Treatment (DDCMHT) Index, (2) use the results of that assessment to drive a quality improvement process through a six month learning collaborative, and (3) repeat the self-assessment to measure progress. To assess reliability of the second self-assessment, we invited programs to also participate in an objective DDCMHT assessment with an independent rater. Participating programs rated themselves similarly to the objective rater and demonstrated significant improvements following participation in a quality improvement process. These findings suggest that intermediary organizations may be positioned to provide expert training and technical assistance to help organizations integrate selfassessments with quality improvement activities. Keywords Intermediary • Fidelity • Self-assessment • Implementation • Co-occurringFidelity scales guide implementation efforts (e.g., as a repeated measurement guiding continuous quality improvement), ensuring that practices are delivered as intended (Bertram et al. 2015;Fixsen et al. 2019). Typically, these assessments are conducted by independent raters who spend a day in a program reviewing documentation and interviewing leadership, supervisors, staff, and service recipients (Bond et al. 2009). Independent assessments can be expensive and time-consuming, and this expense is multiplied when assessments are repeated and include the many evidence-based practices that most programs strive to provide.

show abstract

Section: Discussionmentioning

confidence: 76%

“…This pilot, including eleven programs, found that self-assessment and independent fidelity ratings did not differ significantly from one another (Margolies et al 2017). Further, there was a significant positive relationship between self-reported fidelity and employment that was sustained for a year (Margolies et al 2018).…”

mentioning

confidence: 85%

Intermediary Organizations Can Support Integration of Fidelity Self-assessment and Quality Improvement

Covell

Foster²,

McGovern

et al. 2021

Glob Implement Res Appl

Self Cite

View full text Add to dashboard Cite

show abstract

“…The first was the use of a randomized controlled design. As described in a review of (21,22), a stronger focus on aligning the current study with best practices may have rendered higher rates of employment. Additionally, the population served had low rates of psychotic disorders, resulting in limitations to generalizability.…”

Section: Discussionmentioning

confidence: 96%

Blending Traditional Vocational Services and Individualized Placement and Support for Formerly Incarcerated Veterans

LePage¹,

Crawford

Cipher

et al. 2020

View full text Add to dashboard Cite

This study compared two vocational programs: the About Face Vocational Program (AFVP), a traditional group-based vocational program created for formerly incarcerated veterans, and a hybrid program combining the AFVP with principles of individual placement and supportsupported employment. Methods:The study evaluated 111 veterans with at least one felony conviction who had a mental illness, substance use disorder, or both. Veterans were randomly assigned to either vocational condition.Results: Veterans in the hybrid condition, compared with the AFVP alone, were more likely to find employment, had higher rates of full-time employment, and earned significantly more money over the course of the study. A comparison of only participants who found employment showed higher rates of full-time employment for veterans in the hybrid condition but similarities between the two groups in other measures of employment success.Conclusions: Blended models of vocational services for veterans with mental illness, substance use disorders, or both are effective at returning formerly incarcerated veterans to competitive employment.

show abstract

“…While self-assessment might lead to bias under certain conditions (e.g., when licensing depends upon proving model fidelity), there is some emerging evidence that, when supported as part of a quality-improvement process without penalty, self-assessment and independent fidelity ratings do not differ significantly from one another (Covell et al, 2021a , b ; Margolies et al, 2017 ). Further, one study demonstrated a significant positive relationship between self-reported fidelity and outcomes (employment) that was sustained for a year (Margolies et al, 2018 ). Third, the agency described herein is a large well-resourced agency.…”

Section: Discussionmentioning

confidence: 99%

Self- Evaluation Tool to Support Implementation of Treatment for Tobacco Use Disorder in Behavioral Health Programs

Covell

Foster²,

Lipton³

et al. 2021

Community Ment Health J

Self Cite

View full text Add to dashboard Cite

Tobacco use in people with behavioral health conditions remain two to three times higher than the general population causing premature death and impacting recovery negatively across several domains. Intermediary organizations can provide practical tools, training, and technical assistance to help programs improve capacity to treat tobacco use. This report describes the construction and application of the Tobacco Integration Self-Evaluation Tool (TiSET) for behavioral health programs, a 20-item scale inspired by the DDCMHT and additional content from the Facility Tobacco Policy and Treatment Practices Self-Evaluation tool that one of the study authors (JW) used previously with addiction treatment programs. Completing the TiSET is an important step for behavioral health programs to evaluate their ability to effectively treat people that use tobacco. An important next step is to use those results to facilitate a quality improvement process. We include large agency example illustrating how the TiSET can be applied in real-world practice.

show abstract

Relationship Between Self-Assessed Fidelity and Self-Reported Employment in the Individual Placement and Support Model of Supported Employment

Abstract: Higher-fidelity implementation of the IPS model, as self-assessed by program sites, was associated with higher employment rates, which were sustained over time.

Cited by 12 publications

References 14 publications

Intermediary Organizations Can Support Integration of Fidelity Self-assessment and Quality Improvement

Intermediary Organizations Can Support Integration of Fidelity Self-assessment and Quality Improvement

Blending Traditional Vocational Services and Individualized Placement and Support for Formerly Incarcerated Veterans

Self- Evaluation Tool to Support Implementation of Treatment for Tobacco Use Disorder in Behavioral Health Programs

Contact Info

Product

Resources

About