Treatment Integrity of School-Based Interventions with Children in the Journal of Applied Behavior Analysis 1991–2005

Abstract

We reviewed all school-based experimental studies with individuals 0 to 18 years published in the Journal of Applied Behavior Analysis (JABA) between 1991 and 2005. A total of 142 articles (152 studies) that met review criteria were included. Nearly all (95%) of these experiments provided an operational definition of the independent variable, but only 30% of the studies provided treatment integrity data. Nearly half of studies (45%) were judged to be at high risk for treatment inaccuracies. Treatment integrity data were more likely to be included in studies that used teachers, multiple treatment agents, or both. Although there was a substantial increase in reporting operational definitions of independent variables, results suggest that there was only a modest improvement in reported integrity over the past 30 years of JABA studies. Recommendations for research and practice are discussed.DESCRIPTORS: treatment integrity, child studies, school interventions, applied behavior analysisThe field of applied behavior analysis has always rested on the fundamental principle that the empirical demonstration of measurable changes in behavior must be related to systematic and controlled manipulations in the environment. That is, the observed changes in the dependent variable (behavior) must be attributed to changes in the independent variable (some environmental event). Without this empirical demonstration, a true science of human behavior is an impossibility (Skinner, 1953). Without objective and documented specification of an independent variable as well accurate independent variable application, definitive conclusions regarding the relation between an independent variable and a dependent variable are compromised. The best way to ensure accurate application of the independent variable is to measure the extent to which treatment is implemented as intended.Documentation of independent variable implementation has been discussed in the literature under the rubric of treatment fidelity (Moncher & Prinz, 1991) or treatment integrity Gresham, Gansle, Noell, & Cohen, 1993;Peterson, Homer, & Wonderlich, 1982;Yeaton & Sechrest, 1981). Treatment integrity refers to the degree to which treatments are implemented as planned, designed, or intended and is concerned with the accuracy and consistency with which interventions are implemented We thank Heidi Olson-Tinker, Lisa Dolstra, Veronica McLaughlin, and Mai Van for assistance with the initial preparation of this article. We also are grateful to Michael J. Vance for assistance with data collection.

Global Measures of Treatment Integrity May Mask Important Errors in Discrete-Trial Training

“…As recommended in previous literature (McIntyre et al 2007;Vollmer et al 2008), we suggest scheduling brief observations during a small percentage of sessions (e.g., 15-25 %) or during a scheduled period (e.g., once or twice per week). The duration of these observations will differ depending on factors such as session duration, supervisor availability, and number of clients present.…”

Social Validity Assessment of Training Methods to Improve Treatment Integrity of Special Education Service Providers

“…Treatment integrity refers to the degree to which intervention procedures are implemented as planned, designed, or intended (McIntyre et al 2007;Solomon et al 2012). Research has shown that high treatment integrity is associated with positive therapeutic outcomes (Fiske 2008;Noell et al 2002;Wilder et al 2006).…”

A Spotlight on Treatment Intensity: An Important and Often Overlooked Component of Intervention Inquiry

“…Several special issues on the topic have been published in journals, such as Clinical Psychology Science and Practice (Southam-Gerow and McLeod 2013), School Psychology Review (e.g., Sanetti and Kratochwill 2009), and in this journal-Journal of Behavioral Education (DiGennaro Reed and Codding 2014). Numerous reviews on various aspects of the procedural fidelity literature have been conducted (e.g., Barnett et al 2014;Griffith et al 2009;McIntyre et al 2007;Noell et al 2014;Sanetti et al 2011;Solomon et al 2012;Swanson et al 2013). Professional organizations and grant-funding agencies have encouraged the collection and study of procedural fidelity, yielding a rapid increase in the rate of publications targeting the topic since 2008 (DiGennaro Reed and Codding 2014).…”