Derivation, Replication, and Validity Analyses of a Screener for the Behavioral Assessment of Executive Functions in Young Adults

Abstract

Ecologically valid indicators of executive functions are designed to capture dysfunction not easily measured in a lab setting. Here, we present two studies on the development and validity analyses of a behavioral screener for executive functions among young adults. In Study 1, we derived a four-factor (problem solving, attentional control, behavioral control, and emotional control) behavioral screener using a sample of 765 individuals. We used invariance analyses to evaluate the screener's measurement reliability across sex. In Study 2, we replicated the screener derivation analyses using an independent sample of 197 undergraduates. To further examine the screener's validity, we evaluated it against a well-known executive functions rating scale. The four-factor model was supported in both samples and analyses provided support for this screener as a valid and reliable measure for everyday executive functions among young adults.

Executive Functions Rating Scale and Neurobiochemical Profile in HIV-Positive Individuals

“…The term “executive functions” represent an umbrella term for the interrelated functions that are responsible for purposeful, goal-directed, and problem-solving behavior in the everyday, “real world” environment (Goldstein et al, 2014 ). These functions are unique to our experience as human beings and critical for the successful and adaptive everyday functioning (Duggan, 2014 ). Given the central importance of the executive functions for the direction and control of the dynamic “real world” behavior, the reliance on traditional performance measurements can lead to a limited, incomplete assessment (Gioia and Isquith, 2004 ; Isquith et al, 2013 ).…”

“…Given the central importance of the executive functions for the direction and control of the dynamic “real world” behavior, the reliance on traditional performance measurements can lead to a limited, incomplete assessment (Gioia and Isquith, 2004 ; Isquith et al, 2013 ). Resulting from an effort to produce a more complete and ecologically valid understanding of executive functioning, a number of rating scales have been developed in order to assess the behavioral aspects of executive function within an everyday real-world context; these scales can potentially serve as an ecological validity index for clinical or laboratory findings (Isquith et al, 2013 ; Duggan, 2014 ; Silver, 2014 ). In this sense, executive function rating scales were originally intended to serve as complementary measures to traditional assessment methods; however, studies have shown that performance-based and rating-based measurements assess different aspects of executive functioning and provide important complementary information to clinicians and researchers (Isquith et al, 2013 ; Toplak et al, 2013 ; Duggan, 2014 ; Silver, 2014 ).…”

“…According to Duggan ( 2014 ), some of the primary strengths of executive function rating scales are the ability to assess application of executive skills (rather than the functionality of their components), the capacity to capture executive characteristics of everyday functioning in clinical setting, the contributions of distinct information to executive function assessment, and the potential correlations with biological markers (Gioia et al, 2010 ; Isquith et al, 2013 ; Toplak et al, 2013 ). The presumed neurological basis for deficits in EF makes the relationship between markers of neuronal function and ratings on these scales an expected finding, especially in clinical populations (Isquith et al, 2013 ).…”

Young Adult Routines Inventory (YARI): Development and Initial Validation

“…Other measures related to time management and routines include The Barkley Deficits in Executive Functioning Scale (Barkley, 2011 ), a measure used to assess commonly cited constructs of EF in adults (i.e., inhibition, working memory, organization, problem solving, time management, and self-regulation of emotions; Barkley, 2011 , 2012 ). Similarly, Duggan et al ( 2018 ) developed a valid and reliable screener of EF in young adults based on the college version of the Behavioral Assessment System for Children (Reynolds & Kamphaus, 2004 ). The screener assesses EF behaviors such as problem solving, attentional control, behavioral control, and emotional control.…”

Sensitivity and Specificity of an Executive Function Screener at Identifying Children With ADHD and Reading Disability

“…A rich body of research has evaluated the utility of the Behavior Assessment System for Children (BASC) at assessing executive functions (Duggan, Garcia-Barrera, & Müller, 2018; Garcia-Barrera, Duggan, Karr, & Reynolds, 2014; Garcia-Barrera, Kamphaus, & Bandalos, 2011; Garcia-Barrera, Karr, Duran, Direnfeld, & Pineda, 2015; Garcia-Barrera, Karr, & Kamphaus, 2013; Sadeh, Burns, & Sullivan, 2012). Using the BASC-2 Teacher and Parent Rating Scales for Children (TRS-C and PRS-C, respectively), a past derivation study established the reliability and validity of the BASC-2-EF, a four-factor screener embedded in each form that effectively measured four executive-related constructs: problem solving, attentional control, behavioral control, and emotional control (Karr & Garcia-Barrera, 2017).…”