Psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) Teacher Rating Scale and multiple gating procedure within elementary and middle school samples

Abstract

The primary purposes of this investigation were to (a) continue a line of research examining the psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener - Teacher Rating Scale (SAEBRS-TRS), and (b) develop and preliminarily evaluate the diagnostic accuracy of a novel multiple gating procedure based on teacher nomination and the SAEBRS-TRS. Two studies were conducted with elementary and middle school student samples across two separate geographic locations. Study 1 (n=864 students) results supported SAEBRS-TRS defensibility, revealing acceptable to optimal levels of internal consistency reliability, concurrent validity, and diagnostic accuracy. Findings were promising for a combined multiple gating procedure, which demonstrated acceptable levels of sensitivity and specificity. Study 2 (n=1534 students), which replicated Study 1 procedures, further supported the SAEBRS-TRS' psychometric defensibility in terms of reliability, validity, and diagnostic accuracy. Despite the incorporation of revisions intended to promote sensitivity levels, the combined multiple gating procedure's diagnostic accuracy was similar to that found in Study 1. Taken together, results build upon prior research in support of the applied use of the SAEBRS-TRS, as well as justify future research regarding a SAEBRS-based multiple gating procedure. Implications for practice and study limitations are discussed.

Predicting Academics via Behavior Within an Elementary Sample: An Evaluation of the Social, Academic, and Emotional Behavior Risk Screener (Saebrs)

“…A series of studies have supported SAEBRS psychometric defensibility, with research conducted across multiple geographic areas with diverse student samples across the K-12 spectrum. Results of these studies have supported SAEBRS (a) internal consistency (coefficient alpha = .79-.94); (b) inter-rater reliability (r = .35-.41); (c) criterion-related validity, as evidenced by strong correlations with the SSIS, BESS, SRSS, and Student Internalizing Behavior Screener; and (d) diagnostic accuracy in predicting behavioral risk, with SAEBRS scales exhibiting strong sensitivity (.81-.97) and specificity (.65-.93) (Kilgus et al, 2013(Kilgus et al, , 2015Kilgus et al, 2016).…”

“…Initial SAEBRS studies have yielded promising findings, demonstrating the screener's internal consistency and inter-rater reliability, as well as criterion-related validity and diagnostic accuracy relative to various behavioral outcomes (Kilgus et al, 2013;Kilgus, Eklund, von der Embse, Taylor, & Sims, 2016). A single study has also yielded preliminary evidence regarding whether an initial version of the SAEBRS, which included the SB and AB subscales only, predicted student academic performance (Kilgus et al, 2013).…”

Examining the Technical Adequacy of the Social, Academic, and Emotional Behavior Risk Screener

“…A test must be shown to derive data that is consistent across multiple points in time. Prior research (Eklund, Kilgus, von der Embse, Beardmore, & Tanner, 2016; Kilgus, Eklund, et al, 2016; Kilgus, Sims, von der Embse, & Riley-Tillman, 2015; Kilgus, Sims, von der Embse, & Taylor, 2016) on the SAEBRS has examined the psychometric qualities of the data derived from its use but questions remain concerning its ability to obtain similar scores across time (test–retest reliability).…”

“…High-quality universal screenings utilize appropriate informants and technically sound instruments (Kilgus, Eklund, von der Embse, Taylor, & Sims, 2016). The use of technically sound instruments within a systematic screening process reduces the impact of instrumentation error on determining which students require intensified mental health services and, in turn, ensures the accurate and efficient allocation of schools’ manpower and resources (Kilgus, Chafouleas, & Riley-Tillman, 2013).…”

Addressing trauma in schools: Multitiered service delivery options for practitioners

“…The measure and scoring guidelines are freely available (https://www.sdqinfo.org). Another example of a school‐basedsocial screener is the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) (Kilgus, Eklund, von der Embse, Taylor, & Sims, ). This tool is available through fastbridge.org and has strong evidence of reliability ( α = .77–.93 across subscales for teacher ratings), concurrent validity, and diagnostic accuracy for elementary and middle school youth.…”