A Psychometric Evaluation of the Intention Scale for Providers-Direct Items

Abstract

Research on the dissemination and implementation of evidence-based practices (EBP) suggests that there are numerous factors that influence EBP utilization in community mental health settings. This study examined the psychometric properties of the Intention Scale for Providers-Direct Items (ISP-D; 16 items), a questionnaire designed to assess therapists' attitudes, subjective norms, perceived behavioral control, and behavioral intentions towards using EBPs. Participants were youth community mental health providers from the State of Hawaii's Departments of Education (n = 130) and Health (n = 81). A confirmatory factor analysis was conducted with the total sample to evaluate the factor structure of the ISP-D, which provided support for a revised 14-item ISP-D (Model 3) measure that met benchmarks for adequate to good model fit (i.e., c 2 (69) = 117, RMSEA = .057, SRMR = .068, CFI = .944, TLI = .926). Additional analyses were conducted to examine the ISP-D's reliability and convergent validity. All subscales of the revised ISP-D (Model 3) demonstrated acceptable to good internal consistency, with the exception of the perceived behavioral control scale (⍺ = .63; questionable). The majority of convergent validity correlation patterns between the ISP-D and related constructs were statistically significant and in predicted directions. Implications and suggestions for future research are discussed. Power…………………………………………………………………………….

Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a large and representative Swedish sample: is the use of the total scale and subscale scores justified?

“…The total score includes more items than each of the four domain-specific subscales and therefore provides a larger breadth in terms of content validity and increased reliability. Previous studies find stronger evidence of convergent validity for the EBPAS total score than for the subscales but somewhat weaker evidence in relation to the total score's predictive validity [15][16][17][18]. It is important to point out that in any study, a drawback of a using a total score is that you lose information about the relation between the individual facets measured by the scale and a criterion variable [46].…”

“…The convergent validity has been examined by correlation with theoretically related constructs, supporting the total scale and to some extent the subscales [15][16][17][18]. Consistent with expectation, EBPAS total and subscales scores positively correlate with provider education levels, leadership quality and attitudes towards change, and the implementation climate [14,[19][20][21][22].…”

An examination of individual and organizational theory in a pilot virtual facilitated learning collaborative to implement written exposure therapy.

“…After completing consultation, clinicians also completed the Intention Scale for Providers Direct Items-14 (ISP D-14; Mah et al, 2020). Based on the theory of planned behavior (Ajzen, 1991), this measure assessed clinicians’ behavioral intentions to continue using WET, as well as their attitudes toward WET, subjective norms from people around them supporting use of WET, and their perceived behavioral control over whether to use WET.…”

Rising from the ashes by expanding access to community care after disaster: An origin story of the Wildfire Mental Health Collaborative and preliminary findings.

“…Notably, they were more likely to use an adapted form of SPR than they were to use a supportive, nonskills-based therapy or another intervention. While an insufficient number of surveys were received back to report on whether the intent aligns with what was actually done in practice, the Theory of Planned Behavior suggests that higher levels of intent are associated with higher levels of the intended behavior, particularly in conjunction with positive attitudes or perceptions and perceived behavioral control (Mah et al, 2019).…”

“…The Theory of Planned Behavior framework was employed to guide the evaluation because it has been shown to predict eventual implementation (Breslin et al, 2001). At the end of the workshop, additional surveys were administered to evaluate satisfaction with the workshop, and intent to use SPR after training (Intention Scale for Providers, Mah et al, 2019).…”