The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology

Abstract

This article considers the scientific process whereby new and better clinical tests of executive function might be developed, and what form they might take. We argue that many of the traditional tests of executive function most commonly in use (e.g., the Wisconsin Card Sorting Test; Stroop) are adaptations of procedures that emerged almost coincidentally from conceptual and experimental frameworks far removed from those currently in favour, and that the prolongation of their use has been encouraged by a sustained period of concentration on "construct-driven" experimentation in neuropsychology. This resulted from the special theoretical demands made by the field of executive function, but was not a necessary consequence, and may not even have been a useful one. Whilst useful, these tests may not therefore be optimal for their purpose. We consider as an alternative approach a function-led development programme which in principle could yield tasks better suited to the concerns of the clinician because of the transparency afforded by increased "representativeness" and "generalisability." We further argue that the requirement of such a programme to represent the interaction between the individual and situational context might also provide useful constraints for purely experimental investigations. We provide an example of such a programme with reference to the Multiple Errands and Six Element tests. (JINS, 2006, 12, 194-209.)

Rehabilitation of Executive Functions in Patients with Chronic Acquired Brain Injury with Goal Management Training, External Cuing, and Emotional Regulation: A Randomized Controlled Trial

“…The relationship between tests and assumed cognitive domains furthermore has varying levels of validity (Burgess et al, 2006), tests of EF typically tap multiple cognitive functions (Chan et al, 2008), and repeated administrations raises the issue of practise effects (Sohlberg et al, 2000). Since EF is crucial in managing new situations, and a test can only be new once, tests of EF might face particular test-retest reliability issues (Burgess, Alderman, Evans, Emslie & Wilson, 1998).…”

Strategy‐based reasoning training modulates cortical thickness and resting‐state functional connectivity in adults with chronic traumatic brain injury

“…CT scanning also has limited ability to identify TBI‐related abnormalities (e.g., Tellier et al., 2009). Neuropsychological tests have also been criticized for the lack of ecological validity, meaning the test scores do not adequately reflect daily function levels (Burgess et al., 2006). …”

Involvement of right dorsolateral prefrontal cortex in ill-structured design cognition: An fMRI study

“…They may be interpreted in more than one way and lack a unique solution. Seeing as ill-structured tasks typically lack welldefined criteria for evaluating whether the goal has been met, these tasks are typically "open ended" in the sense that it may not be obvious at what point the task has been completed (Burgess et al, 2006;Goel and Grafman, 2000;Reitman, 1964).…”