Background
The effectiveness of interventions based on applied behavior analysis (ABA) for individuals with autism has been well documented in numerous meta-analyses, systematic reviews, and cost-benefit analyses. However, an observed ‘efficacy-effectiveness gap’ exists, which can be attributed to various factors. This third replication study, therefore, has significant implications for the field. By assessing the impact of ABA treatment, specifically involving discrete trial training and mass trials, within a naturalistic environment, the study provides valuable insights that can inform and improve the delivery of ABA treatments in real-world settings.
Methods
The study was conducted using a repeated measures research design. Retrospective chart review data were collected from 62 individuals with autism, age (M=8.65, SD=4.53), all of whom were level two autistic and required moderate support in communication, socialization, and daily life. These individuals received ABA treatment over five months. The study measured cumulative target behaviors using a repeated measures design, which allowed for the identification of statistically significant differences across 12 time points. This robust methodology ensures the validity and reliability of the study's findings.
Results
Mixed repeated measures analysis of variance (ANOVA) indicated statistical significance (sphericity assumed), F(11,495) = 55.432, p < 0.001 (time). Multiple comparisons using bootstrapped paired t-tests showed p < 0.05 on time points 1-8 and non-significance (p > 0.05) on time points 9-12. There was a significant interaction effect (sphericity assumed) with time x (age category), F(44,495) = 2.338, p < 0.001. Interaction contrasts indicated statistically significant differences over time, mainly within the one-year to four-year-old, five to eight-year-old, and most in the nine to 12-year-old age groups. There was some significance within the 13- to 16-year-old age group and no significance within the 17- to 26-year-old age group.
Conclusions
Over five months, individuals with autism who underwent ABA treatments demonstrated a statistically significant enhancement in general target behaviors. This finding is crucial as it underscores the effectiveness of ABA treatments in a naturalistic environment. Moreover, the study's discovery of a significant interaction between time and age in these behaviors provides valuable insights into the impact of age on treatment outcomes. Extensive large-N studies of general ABA broad effectiveness and repeated measures designs are lacking and can lead to further research to improve quality and outcomes. These findings contribute to the body of empirical evidence and emphasize the importance of replicative efficacy studies in ensuring the reliability of research findings.