Teacher's PETS: a new observational measure of experiential training interactions

Abstract

Government policy now stresses the importance of staff training in fostering evidence-based practice, but what is done in the name of training is rarely reported and there are few instruments with which to analyse training. Therefore, the purpose of the present study was to develop a new measure of training processes and mini-outcomes, and to provide a case study illustration. A single subject .N = 1/ withdrawal design was used to assess the empirical validity of the measure. The measure (Teacher's PETS) was derived from the applied psychology literature in order to operationalize Kolb's (1984) integrative theory of experiential learning. Reliability and validity assessments were conducted. During the intervention phase of the case study baseline data from PETS were fed back to the trainer. The effectiveness of this intervention was assessed structurally and functionally, in relation to the learners, i.e. mental health staff .N = 31/ receiving training in evidence-based practice (psychosocial interventions in severe mental illness). PETS was found to have very good inter-rater reliability .K = 0.84/ and promising content, empirical and concurrent validity. The case study illustrated that, at baseline, the training did not correspond to a 'training workshop'. However, the intervention of feedback and modelling resulted in more appropriate training processes and outcomes, which were maintained at a 1-month follow-up assessment. It is concluded that PETS shows promise as an instrument and has the advantage of affording detailed, transactional information to improve the efficiency of training. It may also be useful in relation to clinical supervision.

Supervising Cognitive-Behavioral Psychotherapy: Pressing Needs, Impressing Possibilities

“…This direct observational tool, called ''Supervision, Adherence and Guidance Evaluation'' (SAGE) is an empirically-derived instrument that assesses the competence of supervisors on 23 behaviors pertinent to effective supervision. SAGE has evolved from two closely-related instruments: Teacher's PETS (Milne et al 2002) and CBT STARS (Blackburn et al 2001). SAGE allows an observer to systematically code supervision sessions, so that judgments about competence, feedback and fidelity evaluations can be conducted.…”

Outcome Evaluation of Brief Psychosocial Training for Cardiac Rehabilitation Staff

“…The Process Evaluation of Training and Supervision instrument 11 uses an observational momentary time sampling technique to assess the integrity of training. A profile of the training process is obtained by alternately recording trainer and participant behavior allowing observation of the impact of specific teaching styles on trainee behavior.…”

Microskills of Clinical Supervision: Scaffolding Skills

“…In a series of empirical studies, Milne et al (2002) developed a useful list of activities engaged in by supervisors. This list has been packaged into a tool called "Teachers PETS" (Process Evaluation of Training and Supervision; Milne et al, 2002;Milne, Pilkington, Gracie, & James, 2003).…”

“…This list has been packaged into a tool called "Teachers PETS" (Process Evaluation of Training and Supervision; Milne et al, 2002;Milne, Pilkington, Gracie, & James, 2003). PETS is an observational instrument that provides a system for coding the speech of supervisors and their supervisees.…”

“…Within the supervisory setting, microskills are the moment-to-moment activities that supervisors use within supervision sessions to promote learning and supervisee competence. Microskills may be verbal or nonverbal in character, involving the imparting of facts, the promoting of reflection (Bennett-Levy, 2006), action planning, and the use of experiential exercises (Kolb, 1984;Milne, James, Keegan, & Dudley, 2002). In many respects, the exchanges occurring within supervision are more complex than those occurring within therapy, because the supervisor is attempting to influence clinical outcomes indirectly through the work of the supervisee.…”