The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.

No abstract

No abstract

A two part study investigated the reliability and validity of a new behavioural rating scale, the Verbal Report Form (VRF), in measuring brief unstructured verbal interactions of chronic mental patients. In Study 1, six subjects rated 12 video taped segments of verbal behaviour differing in length of time. The results indicated that a 2-minute time segment was necessary to accurately assess conversational behaviour (mean rater agreement = .76). In Study 2, 15 raters (five psychologists, five psychiatric technicians, and five non-professional community members) rated 15 2-minute video tapes of verbal behaviour (five hospitalized patients, five board and care residents, and five normals). Results of an analysis of variance suggest that the VRF could discriminate among the three contrasting groups using the number of inappropriate responses rated (p < .01). Results are also discussed in terms of differences between raters and difference in the discriminability of the categories of the VRF.

No abstract