Reliability of a measure of the quality of cognitive therapy

Abstract

This study investigates some of the psychometric properties of the Cognitive Therapy Scale (CTS) using a sample of experienced psychotherapists. Four raters, experienced in cognitive therapy, rated a total of 21 independent, videotaped psychotherapy sessions, and provided ratings along the dimensions of therapist competence measured by the CTS. Analyses included item intercorrelations, item-total correlations, and two assessments of inter-rater reliability. Inter-rater reliabilities showed a significant positive correlation for all items of the CTS and the internal reliability was strong. The potential of the CTS to address both the competency of cognitive therapists and trainees is discussed.

A comparison of the Dodo, EST, and ATI factors among comorbid stimulant‐dependent, depressed patients

“…The therapy was supervised by a clinician who was trained in the use of CT by Dolores Gallagher-Thompson, and Larry Thompson, two of the co-investigators in this study. Based on independent and blind adherence ratings, CT therapists consistently performed in a manner that was consistent with expectations (Dobson et al, 1985). Based on previously validated ratings of the therapy processes targeted in this study (Malik et al, 2003), it was consistent with other renditions of CT and was characterized as being therapist guided, symptomfocused, and emotionally supportive (see Table 1).…”

“…It was conducted by four therapists, all of whom were in compliance with CT criteria developed by Dobson et al (1985). The therapy was supervised by a clinician who was trained in the use of CT by Dolores Gallagher-Thompson, and Larry Thompson, two of the co-investigators in this study.…”

“…Each group of therapists met for group supervision once per week, and during this time, cases were supervised and fidelity/adherence to the treatment protocols were assessed. Standard CT adherence measures were used (Dobson, Shaw, & Vallins, 1985) for CT, and corollary measures were developed for NT and PT conditions. Adherence and skill was rated by the supervisor for at least one of every five treatment sessions using the standard compliance forms and therapists who failed to meet criteria of acceptability were subject to additional training and supervision.…”

Expert Insight into the Assessment of Competence in Cognitive–Behavioural Therapy: A Qualitative Exploration of Experts' Experiences, Opinions and Recommendations

“…This typically involved rating audio or video recordings of treatment sessions using standardized rating scales. In particular, participants used the CTS and CTS-R (CTS-R: Blackburn et al, 2001; CTS: Dobson et al, 1985), although it was perceived as 'a bit of a wobbly instrument' (P11). Criticisms included a lack of applicability beyond depression, failure to account for disorder/protocol-specific competences or stage of therapy, under emphasis of the therapeutic relationship, unclear instruction manual, ambiguity and lack of behavioural specificity in scale item descriptors, a high degree of assessor inference, poor inter-rater reliability and a lack of opportunity to provide formative feedback.…”

Attitudes to Group Assessments: Prospective Psychotherapists’ Experiences of Being Assessed by Fellow Students

“…One of the earliest developed assessment tools was the Cognitive Therapy Scale (CTS) developed by Beck and Young [32]. The scale measures adherence and competence and have been widely used in psychotherapy research and is considered to have acceptable psychometric properties [33]. A number of other scales reminiscent of the CTS have been developed, as Safran's Therapy Adherence Scale (STAS) [34], Cognitive Therapy Adherence and Competence Scale (CTACS) [35], Assessment of Core CBT Skills (ACCS) [36], Supervisor Rating Form (SRF) [37], the Collaborative Case Conceptualization Rating Scale (CCCRS) [38], and the UCL scale of Structured Observation (USO) [39].…”