Evaluating training effectiveness in psychotherapy: lessons for the AOD field

Abstract

Based on evaluations of effectiveness training on trainee and client outcome in the psychotherapy field, this paper presents a model and recommendations for the alcohol and other drug (AOD) field to consider when conducting investigations into training. Determining the effectiveness of training requires the consideration of a number of factors, including pre-existing trainee variables, methods of training and ability of trainers and the focus of training. The influence of each of these factors may be considered first in terms of proximal outcomes such as trainee satisfaction, improvements in clinical practice and knowledge, and secondly in terms of more distal outcomes, such as the impact that training may have on improving client outcome. The current literature regarding these factors pertaining to psychotherapy outcome is reviewed, and recommendations for evaluating training in the AOD field are made.

Brief Intervention Training for Smoking Cessation in Substance Use Treatment

“…There is a paucity of research with a few notable exceptions (e.g., O'Donovan & Dawe, ; Roche, ) within the AOD field relating to training design, evaluation, and transfer (Pidd et al., ). Overall, the focus of any strategies that have been implemented has been the development of practitioner skills and knowledge to respond to AOD issues (Allsop & Stevens, ).…”

Short-Term and Long-Term Effects of Training in Emotionally Focused Couple Therapy: Professional and Personal Aspects

“…There is an even greater gap in the field’s understanding of the long‐term consequences of training. Researchers have most frequently sought to measure training effectiveness by examining trainee satisfaction, increase in content knowledge (Miller & Mount, 2001; O’Donovan & Dawe, 2002; O’Donovan, Bain, & Dyck, 2005; Tori, 1989), or improvement in clinical skills (Buckley, Conte, Plutchik, Karashu, & Wild, 1982; Henry, Schacht, Strupp, Butler, & Binder, 1993; Hilsenroth, Defife, Blagys, & Ackerman, 2006; O’Donovan & Dyck, 2005; Sholomskas et al., 2005). Many training studies report optimistic findings regarding therapists’ skill acquisition (Burlingame, Fuhriman, Paul, & Ogles, 1989; Henry et al., 1993; Hilsenroth et al., 2006; Multon, Kivlighan, & Gold, 1996), but some conclude there are little to no effects (or even negative effects) with training (Bein et al., 2000, Miller & Mount, 2001; Svartberg & Stiles, 1994).…”

Workforce Issues and the Treatment of Alcohol Problems: A Survey of Managers of Alcohol and Drug Treatment Agencies

“…The priority education and training is receiving is highlighted by the growing literature on what should be included in training, how to deliver the training, and how to evaluate the effectiveness of the training (cf. Ask et al, 1998, Roche, 1998, O'Donovan and Dawe, 2002. Ask and colleagues (1998) identified possible methods and goals of education and training for alcohol and drug specialist workers as well as a range of other professions, including medical doctors, nurses, psychiatrists, ambulance officers, social workers, teachers, pharmacists, police and magistrates.…”