Know thyself: Executive functioning and sex predict self-appraisal of functional abilities in community-dwelling older adults

Mora, Michelle Gereau; Suchy, Yana

doi:10.1080/13854046.2023.2167738

Cited by 5 publications

(1 citation statement)

References 103 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Despite these strengths, the impact of these studies is somewhat diminished by the fact that four out of six relied only on behavioral ratings as evidence of functional outcome, an issue that is pervasive in the EV literature (Robertson & Schmitter-Edgecombe, 2017). While various rating scales of daily functioning are themselves often touted as being ecologically valid (Moncivais et al, 2022; Toplak et al, 2013), multiple studies have pointed to considerable discrepancies between responses on such subjective ratings and actual daily functioning (e.g., Fogel, 2022; Harty et al, 2013; Mitchell & Miller, 2008a; Mora & Suchy, 2023; Schmitter-Edgecombe et al, 2011; Smith et al, 2000; Steward et al, 2019; Suchy et al, 2011). Thus, to accomplish proper validation, additional research is needed that relies on other assessment modalities, such as performance of IADL tasks in a laboratory or observation of IADLs at home.…”

Section: Discussionmentioning

confidence: 99%

Pitfalls in research on ecological validity of novel executive function tests: A systematic review and a call to action.

Suchy,

Mora,

DesRuisseaux

et al. 2024

Psychological Assessment

Self Cite

View full text Add to dashboard Cite

The term "ecological validity" (EV) has traditionally referred to test scores' ability to predict real-world functioning. However, a test's similarity to real-world tasks is sometimes mistaken for evidence of its ability to predict daily life, sometimes bypassing rigorous validation research. The goal of this systematic review was to examine the type and quality of evidence used to support claims of EV of novel face-valid tests of executive functions (EF). MEDLINE and PsychINFO databases were searched using the following terms: ecologic * AND neuropsychol * AND (executive function * OR executive dysfunction OR executive abilit * ). Thirty-two articles that explicitly stated that their results demonstrated EV of a novel face-valid test of EF were identified. Results showed that only 60% of studies based their claims about EV on test scores' ability to predict functional outcomes, with the remaining 40% relying on other evidence (e.g., correlations with other measures, participant feedback, group differences). Among the studies that did base their conclusions on test scores' ability to predict outcomes (n = 19), an overwhelming majority relied on behavioral rating scales, utilized small sample sizes and participant-to-variable ratios, and failed to control for covariates and multiple comparisons. Poor scientific rigor was particularly pronounced in studies of "naturalistic" tests. The present systematic review reveals significant conceptual, methodological, and statistical flaws among an overwhelming majority of studies that claim to have found support for the EV of a novel face-valid test of EF. We call upon authors, reviewers, and editors to safeguard the scientific rigor of research in this area. Public Significance StatementThis literature review reveals considerable inconsistency in the quality of evidence among neuropsychological studies that claim to have demonstrated "ecological validity" of tests designed to resemble real-world tasks and intended for use as predictors of patients' daily functioning. We call upon neuropsychologists to use clearer terminology and to avoid common pitfalls in this type of test development research to improve our field's ability to interpret results of neuropsychological evaluations.

show abstract

Section: Discussionmentioning

confidence: 99%

Pitfalls in research on ecological validity of novel executive function tests: A systematic review and a call to action.

Suchy,

Mora,

DesRuisseaux

et al. 2024

Psychological Assessment

Self Cite

View full text Add to dashboard Cite

show abstract

Time-Based prospective memory predicts insight into functional abilities among community-dwelling older adults

Gereau Mora,

DesRuisseaux,

Suchy

2024

J Int Neuropsychol Soc

View full text Add to dashboard Cite

Objective: Accurate appraisal of one’s own abilities (i.e., insight) is necessary for appropriate compensatory behaviors and sustained independence during aging. Although insight is often purported to be related to executive functioning (EF), nuanced understanding of the cognitive correlates of insight for functional abilities among nondemented older adults is lacking. Because insight shares neuroanatomic underpinnings with time-based prospective memory (PM), the present study examined the contributions of time-based PM, beyond event-based PM and other potential cognitive confounds (i.e., episodic memory, time estimation, and EF), in predicting insight into one’s own performance on instrumental activities of daily living (IADLs) among community-dwelling older adults. Method: A group of 88 nondemented, community-dwelling older adults completed performance-based measures of time- and event-based PM, episodic memory, time estimation, and EF, as well as IADL tasks followed by self-appraisals of their own IADL performance as indices of insight. Results: Time-based PM was moderately-to-strongly associated with insight, beyond event-based PM, time estimation, and episodic memory [F(1,83) = 11.58, p = .001, ηp2 = .122], as well as beyond EF and demographic covariates [F(1,79) = 10.72, p = .002, ηp2 = .119].Specifically, older adults who performed more poorly on a time-based PM task overestimated the efficiency of their own IADL performance to a greater extent. Conclusions: Findings suggest that nondemented older adults with poorer time-based PM may be more prone to inaccurately appraising their functional abilities and that this vulnerability may not be adequately captured by traditional EF measures.

show abstract

Computerized assessment of executive functioning: Validation of the CNS Vital Signs executive functioning scores in a sample of community-dwelling older adults

DesRuisseaux,

Gereau Mora,

Suchy

2024

The Clinical Neuropsychologist

View full text Add to dashboard Cite

Know thyself: Executive functioning and sex predict self-appraisal of functional abilities in community-dwelling older adults

Cited by 5 publications

References 103 publications

Pitfalls in research on ecological validity of novel executive function tests: A systematic review and a call to action.

Pitfalls in research on ecological validity of novel executive function tests: A systematic review and a call to action.

Time-Based prospective memory predicts insight into functional abilities among community-dwelling older adults

Computerized assessment of executive functioning: Validation of the CNS Vital Signs executive functioning scores in a sample of community-dwelling older adults

Contact Info

Product

Resources

About