Using Modified Visual‐inspection Criteria to Interpret Functional Analysis Outcomes

Roane, Henry S.; Fisher, Wayne W.; Kelley, Michael E.; Mevers, Joanna Lomas; Bouxsein, Kelly J.

doi:10.1002/jaba.13

Cited by 121 publications

(240 citation statements)

References 54 publications

Supporting

Mentioning

232

Contrasting

Order By: Relevance

“…Although not evaluated as a moderator, explicit training in the use of evaluating data with a visual aid clearly produced large effects that were discrepant from no training in the use of such aids (Hagopian et al, 1997;Hojem & Ottenbacher, 1988;Roane et al, 2013;Skiba et al, 1989). Roane et al (2013) compared the provision of written instruction over the use of criterion lines with written plus verbal instruction, finding that verbal instruction led to improved proportions of IRA.…”

Section: Discussionmentioning

confidence: 90%

“…Roane et al (2013) compared the provision of written instruction over the use of criterion lines with written plus verbal instruction, finding that verbal instruction led to improved proportions of IRA. The two studies that did not find a visual aid to improve IRA also did not appear to explicitly train raters in the use of the visual aids (Normand & Bailey, 2006;Ottenbacher & Cusick, 1991).…”

Section: Discussionmentioning

confidence: 98%

See 1 more Smart Citation

Interrater Agreement Between Visual Analysts of Single-Case Data

et al. 2015

View full text Add to dashboard Cite

Visual analysis is the most widely applied method of data interpretation for single-case research as it encompasses multifaceted considerations relevant to evaluating behavior change. However, a previous research synthesis found low levels of interrater agreement between visually analyzed ratings of graphed data across all variables under analysis. The purpose of this meta-analysis was to evaluate the peer-reviewed literature to date for potential moderators affecting the proportion of interrater agreement between visual analysts. Nineteen articles with 32 effects were assembled. Potential moderators evaluated included (a) design families, (b) rater expertise, (c) the provision of contextual information for graphs, (d) the use of visual aids, (e) the provision of an operational definition of the construct being rated, and (f) rating scale ranges. Results yielded an overall weighted interrater agreement proportion of .76. Moderator variables identified produced low to adequate levels of interrater agreement. Practical recommendations for future research are discussed.

show abstract

Section: Discussionmentioning

confidence: 90%

Section: Discussionmentioning

confidence: 98%

Interrater Agreement Between Visual Analysts of Single-Case Data

et al. 2015

View full text Add to dashboard Cite

show abstract

“…One limitation of this study was that the researchers investigated levels of visual-inspection agreement only with FA datasets with 10 data points per condition; therefore, the generality of the findings to FAs of different lengths remained unknown. To address this limitation, Roane, Fisher, Kelley, Mevers, and Bouxsein (2013) refined the structured criteria developed by Hagopian et al to make them applicable to FA datasets of various lengths (see also Cox & Virues-Ortega, 2016). …”

mentioning

confidence: 99%

Predictive validity and efficiency of ongoing visual‐inspection criteria for interpreting functional analyses

Saini

Fisher

Retzlaff

2018

J of App Behav Analysis

Self Cite

View full text Add to dashboard Cite

Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validity and efficiency of applying structured criteria on an ongoing basis by comparing the interim interpretations produced through OVI with (a) the final interpretations produced by PHVI, (b) the authors’ post-hoc interpretations (PHAI) reported in the research studies, and (c) the consensus interpretations of these two post-hoc analyses. Ongoing visual inspection predicted the results of PHVI and the consensus interpretations with a very high degree of accuracy, and PHAI with a reasonably high degree of accuracy. Furthermore, the PHVI and PHAI results involved 32 FA sessions, on average, whereas the OVI required only 19 FA sessions to accurately identify the function(s) of destructive behavior (i.e., a 41% increase in efficiency). We discuss these findings relative to other methods designed to increase the accuracy and efficiency of FAs.

show abstract

“…Initial functional analyses for most individuals followed standard guidelines outlined by Iwata et al (1984Iwata et al ( /1994, with idiosyncratic modifications (e.g., adding a divided attention condition) tailored to each participant based on parental report and preliminary observations. Each FA graph was evaluated using visual analysis methods outlined by Roane et al (2013). Under these procedures, upper criterion (one standard deviation above the mean) and lower criterion (one standard deviation below the mean) lines are drawn around the control condition (e.g., toy play).…”

Section: Methodsmentioning

confidence: 99%

“…Each test condition is then evaluated using the number of data points that fall above the upper criterion and below the lower criterion. In addition, specific rules are applied to account for upward trends, downward trends, low rates of problem behavior, low magnitude effects, multiply maintained problem behavior, and problem behavior maintained by automatic reinforcement (see Appendix in Roane et al 2013 for a complete list of criteria).…”

Section: Methodsmentioning

confidence: 99%

Evaluating the Relationship Between Sleep and Problem Behavior in Children with Disabilities

Scheithauer

Zarcone

2015

Behav Analysis Practice

View full text Add to dashboard Cite

Problem behaviors, such as aggression, self-injury, and disruption, are common reasons for referrals for individuals with developmental and intellectual disabilities (Emerson et al. 2001;Murphy et al. 2009). Several studies using parental report indicate that children with problem behavior are also more likely to have sleep difficulties (e.g., Mazurek et al. 2013;Rzepecka et al. 2011), while others suggest that the two domains are not correlated (Dominick et al. 2007). There has also been support from a direct observation study suggesting that individuals who exhibit problem behavior have more sleep difficulties when compared to national norms (Piazza et al. 1996), but these findings are correlational in nature and do not provide information about a temporal relationship. Thus, it is unclear from current research whether sleep difficulties and problem behavior vary together (e.g., whether behavior is worse on days following low sleep) or whether they are temporally unrelated (Brylewski and Wiggs 1999).In evaluating the relationship between problem behavior and sleep, it is helpful to consider the three-term operant model of antecedents, behaviors, and consequences. Motivating operations are defined as an antecedent event that alters the value of a consequence. One type of motivating operation, an establishing operation, temporarily increases the value of a reinforcer and evokes behaviors that have historically resulted in that reinforcer (Laraway et al. 2003;Michael 1982). Sleep has been identified as a potential motivating operation for problem behavior, especially behaviors maintained by negative reinforcement (e.g., Langhorne et al. 2013). In other words, sleep deprivation (or fatigue) may increase the reinforcing value of escape from demands and make problem behavior maintained by escape more likely to occur when the child has limited sleep. In a practical example, a child may find math work more aversive if he/she is tired, resulting in an increased reinforcement value of escape from math. If the child has historically escaped math work by engaging in aggression, he/she is more likely to engage in this aggression when he/she is tired.There have been a few studies that use direct observation to demonstrate a temporal relationship between sleep and problem behavior and provide support for the idea that lack of sleep might serve as a motiving operation for problem behavior. Studies using pharmacological treatments to improve sleep have found that daytime problem behavior decreases with sleep improvement (Eshbaugh et al. 2004;Sovner et al. 1999). Other support for a temporal relationship between sleep and problem behavior arises from studies evaluating the effects that sleep might have on functional analyses (FAs) outcomes. FAs are usually conducted in a therapeutic setting to determine environmental variables that might maintain an individual's problem behavior. A therapist manipulates the environmental antecedents (e.g., presents demands, appears busy or unavailable for attention, removes a preferred item) an...

show abstract

Using Modified Visual‐inspection Criteria to Interpret Functional Analysis Outcomes

Cited by 121 publications

References 54 publications

Interrater Agreement Between Visual Analysts of Single-Case Data

Interrater Agreement Between Visual Analysts of Single-Case Data

Predictive validity and efficiency of ongoing visual‐inspection criteria for interpreting functional analyses

Evaluating the Relationship Between Sleep and Problem Behavior in Children with Disabilities

Contact Info

Product

Resources

About