Identifying factors that promote sustained implementation of evidence-based treatments (EBTs) after therapists receive training is critical for professional psychology. To address the field's minimal knowledge in this area, we interviewed community-based therapists (N = 23) who had completed intensive training in cognitive behavioral therapy (CBT) for either anxiety or depression as part of a randomized effectiveness trial (Southam-Gerow et al., 2010; Weisz et al., 2009). Therapists were interviewed three to five years after completion of the initial trial, representing one of the longest-term follow-ups of therapist practices after training. Therapists viewed each protocol and their individual CBT strategies as effective and appropriate for the majority of their current anxiety and depression caseloads. However, therapists used parts of each protocol much more frequently than the protocol as a whole (i.e., 78.5% used parts of the Coping Cat, and 7.5% used the whole protocol; 58.6% used parts of the PASCET, and 20% used the whole protocol). Therapists reported using problem-solving the most and exposure exercises the least for current anxious cases; they used cognitive restructuring the most and homework the least for current depression cases. Interventions that were more difficult to implement in usual care settings were less likely to be sustained. Future efforts should evaluate the characteristics and structure of EBTs that are most acceptable to therapists and should investigate which kinds of ongoing learning supports will maintain therapist skills in and continued use of EBTs.
Objective:
Therapistcompetence is an important component of treatment integrity. This paper reports on the development and initial psychometric assessment of the Cognitive-Behavioral Treatment for Anxiety in Youth Competence Scale (CBAY-C), an observational instrumentdesigned to capture therapist limited-domain competence (i.e., competence in the delivery of core interventions and delivery methods found in a specific psychosocialtreatment program) in the delivery of the core practice elements in individual cognitive-behavioral treatment (ICBT) for youth anxiety.
Method:
Treatment sessions (N = 744) from 68 youth participants (M age = 10.60 years, SD = 2.03; 82.3% Caucasian; 52.9% male) of the same ICBT program for youth anxiety from (a) an efficacy study and (b) an effectiveness study were independently scored by four coders using observational instruments designed to assess therapist competence, treatment adherence, treatment differentiation, alliance, and client involvement.
Results:
Inter-rater reliability (intraclass correlation coefficients, ICC(2,2)) for the item scores averaged 0.69 (SD = 0.11). The CBAY-C item, scale, and subscale (Skills, Exposure) scores showed evidence of validity via associations with observational instruments of treatment adherence to ICBT for youth anxiety, theory-based domains (CBT, psychodynamic, family, client-centered), alliance, and client involvement. Importantly, although the CBAY-Cscale, subscale, and item scores did overlap with a corresponding observational treatment adherence instrument independently rated by coders,the degree of overlap was moderate, indicating that theCBAY-C assessesa distinct component of treatment integrity.
Conclusions:
Applications of the instrument and future research directions discussed include the measurement of treatment integrity and testing integrity-outcome relations.
The measurement of treatment adherence (a component of treatment integrity defined as the extent to which a treatment is delivered as intended) is a critical element in treatment evaluation research. This paper presents initial psychometric data for scores on the Cognitive-Behavioral Therapy Adherence Scale for Youth Anxiety (CBAY-A), an observational measure designed to be sensitive to common practice elements found in individual cognitive-behavioral therapy (ICBT) for youth anxiety. Therapy sessions (N = 954) from one efficacy and one effectiveness study of ICBT for youth anxiety were independently rated by two coders. Inter-rater reliability (as gauged by intra-class correlation coefficients) for the item scores averaged 0.77 (SD = 0.15; range .48 to .80). The CBAY-A item and scale (Skills, Model, Total) scores demonstrated evidence of convergent and discriminant validity with an observational measure of therapeutic interventions and an observational measure of the alliance. The CBAY-A item and scale scores also discriminated between therapists delivering ICBT in research and practice settings and therapists delivering non-manualized usual clinical care. We discuss the importance of replicating these psychometric findings in different samples and highlight possible application of an adherence measure in testing integrity-outcome relations.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.