Quantification of behavioral data with effect sizes and statistical significance tests

Costello, Mack S.; Bagley, Raymond F; Bustamante, Laura Fernández; Deochand, Neil

doi:10.1002/jaba.938

Cited by 8 publications

(2 citation statements)

References 67 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With respect to the small yet statistically significant effect observed in overall sound intensity, what remains less clear is whether such a change could be viewed as clinically significant (Ranganathan et al, 2015). Certainly, there has been increased support for the use of inferential statistics in assessing the effects of interventions within applied behavior analytic research (Costello et al, 2022; Fisher & Lerman, 2014; Kazdin, 2021). In addition, past research has documented the noise levels observed in canine shelter environments, which can regularly exceed 100 dB (Coppola et al, 2006; Sales et al, 1997) and result in measurable hearing loss for dogs (Scheifele et al, 2012).…”

Section: Discussionmentioning

confidence: 99%

Evaluation of an automated response‐independent schedule on the behavioral welfare of shelter dogs

Fernández

Anderson²,

Kowalski

2023

J Exper Analysis Behavior

View full text Add to dashboard Cite

Response-independent schedules involve the delivery of an item independent of a response requirement. Often described in the applied behavior analytic literature as "noncontingent reinforcement," they have also frequently been used to reduce undesired or problematic behaviors. The current study examined the use of an automated response-independent food schedule on the behaviors and sound levels of shelter dogs. Several dogs were included in a 6-week reversal design, where a fixed-time 1 min schedule was compared with a baseline condition. Eleven behaviors were measured, as were two areas of each kennel and the overall and session sound intensity (dB) that occurred during the study. The results demonstrated that the fixed-time schedule increased overall activity while decreasing inactivity and led to a reduction in the overall sound intensity measured. Session and hour-tohour sound-intensity data were less clear, suggesting a potential contextual conditioning effect as well as a need for adjusted methods to study shelter sound. The above are discussed in terms of their potential welfare benefits for shelter dogs as well as the translational approach that this and similar research could contribute to the application and functional understanding of response-independent schedules.

show abstract

Section: Discussionmentioning

confidence: 99%

Evaluation of an automated response‐independent schedule on the behavioral welfare of shelter dogs

Fernández

Anderson²,

Kowalski

2023

J Exper Analysis Behavior

View full text Add to dashboard Cite

show abstract

“…Tau may be used across SCD types and do not require a minimum number of replications within or across participants to produce viable coefficients (i.e., between‐case parametric measures; Dowdy et al, 2021). This advantage may be, in part, the reason that ‘Tau and it's variations [i.e., Tau‐U, Tau‐BC] are the leading statistic for identifying the presence or absence of an effect for [single‐case experimental designs]’ (Costello et al, 2022, p. 3). While many advantages may be associated with Tau, specifically Tau‐U, remaining limitations, including the fact that Tau‐U estimates are inflated and not bound between −1 and 1, may make baseline corrected Tau (Tau‐BC) the optimal option for the current study's purpose (Tarlow, 2017).…”

Section: Methodsmentioning

confidence: 99%

Training programme for community service providers who support adults with intellectual disabilities: A systematic quantitative literature review of single‐case research

Mullins,

Scott,

Cox

2023

Research Intellect Disabil

View full text Add to dashboard Cite

BackgroundResearch on training direct support professionals to address challenging behaviour exhibited by adults with intellectual disabilities is essential in generating effective training approaches for this sector. This systematic review's objective was to evaluate the effects of training types and whether specific training delivery components influenced outcomes.MethodsFollowing PRISMA (2020) guidelines, 16 single‐case design studies were included that directly evaluated behaviour change of service providers training for adults with intellectual disabilities in community settings. Study quality was assessed using Horner et al. (Exceptional Children, 2005, 71(2), 165–180) criteria. The database searched included Academic Search Complete, CINAHL, Embase, ERIC, Psych Info, and Web of Science.ResultsDescriptive analysis of effect size outcomes suggested that all training types were associated with improved outcomes. Further, in situ training was associated with improved service provider performance. Interestingly, feedback was associated with poorer service provider performance.ConclusionsWe provide possible explanations for this surprising outcome and propose future research.

show abstract

Assessing Nonoverlap in Single-Case Data: Strengths, Challenges, and Recommendations

Manolov,

Tanious

2024

J Behav Educ

View full text Add to dashboard Cite

Overlap is one of the data aspects that are expected to be assessed when visually inspecting single-case experimental designs (SCED) data. A frequently used quantification of overlap is the Nonoverlap of All Pairs (NAP). The current article reviews the main strengths and challenges when using this index, as compared to other nonoverlap indices such as Tau and the Percentage of data points exceeding the median. Four challenges are reviewed: the difficulty in representing NAP graphically, the presence of a ceiling effect, the disregard of trend, and the limitations in using p-values associated with NAP. Given the importance of complementing quantitative analysis and visual inspection of graphed data, straightforward quantifications and new graphical elements for the time-series plot are proposed as options for addressing the first three challenges. The suggestions for graphical representations (representing within-phase monotonic trend and across-phases overlaps) and additional numerical summaries (quantifying the degree of separation in case of complete nonoverlap or the proportion of data points in the overlap zone) are illustrated with two multiple-baseline data sets. To make it easier to obtain the plots and quantifications, the recommendations are implemented in a freely available user-friendly website. Educational researchers can use this article to inform their use and application of NAP to meaningfully interpret this quantification in the context of SCEDs.

show abstract

Quantification of behavioral data with effect sizes and statistical significance tests

Cited by 8 publications

References 67 publications

Evaluation of an automated response‐independent schedule on the behavioral welfare of shelter dogs

Evaluation of an automated response‐independent schedule on the behavioral welfare of shelter dogs

Training programme for community service providers who support adults with intellectual disabilities: A systematic quantitative literature review of single‐case research

Assessing Nonoverlap in Single-Case Data: Strengths, Challenges, and Recommendations

Contact Info

Product

Resources

About