Variability in color-choice Stroop performance within and across EEG and MRI laboratory contexts

Fehr, Thorsten; Wiechert, Juliana; Erhard, Peter

doi:10.3758/s13414-014-0745-9

Cited by 7 publications

(5 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In certain tasks the "stability of instability" has been shown to have adequate, and in some cases, excellent retest reliability (Fleming, Steiborn, Langner, Scholz, & Westhoff, 2007;Saville et al, 2011). This points towards a possible disconnect between methodological and substantive inquires, in that, for the lat-ter, intraindividual variation (IIV) is often studied in these same tasks (Duchek et al, 2009;Fehr, Wiechert, & Erhard, 2014;Kane et al, 2016). Second, and more generally, if a researcher is interested in individual differences, they have to at least approach the individual level.…”

Section: Discussionmentioning

confidence: 99%

Putting the Individual into Reliability: Bayesian Testing of Homogeneous Within-Person Variance in Hierarchical Models

Williams¹,

Martin²,

Rast³

2019

Preprint

View full text Add to dashboard Cite

Measurement reliability is a fundamental concept in psychology. It is traditionally considered a stable property of a questionnaire, measurement device, or experimental task. Although intraclass correlation coefficients (ICC) are often used to assess reliability in repeated measure designs, their descriptive nature depends upon the assumption of a commonwithin-person variance.This work focuses on the presumption that each individual is adequately described by the average within-person variance in hierarchical models. And thus whether reliability generalizes to the individual level, which leads directly into the notion of individually varying ICCs. In particular, we introduce a novel approach, using the Bayes factor, wherein a researcher can directly test for homogeneous within-person variance in hierarchical models. Additionally, we introduce a membership model that allows for classifying which (and how many) individuals belong to the common variance model. The utility of our methodology is demonstrated on cognitive inhibition tasks. We find that heterogeneous within-person variance is a defining feature of these tasks, and in one case, the ratio between the largest to smallest within-person variance exceeded 20. This translates into a 10 fold difference in person-specific reliability! We also find that few individuals belong to the common variance model, and thus traditional reliability indices are potentially masking important individual variation. We discuss the implications of our findings and possible future directions. The methods are implemented in the R package vICC.

show abstract

Section: Discussionmentioning

confidence: 99%

Putting the Individual into Reliability: Bayesian Testing of Homogeneous Within-Person Variance in Hierarchical Models

Williams¹,

Martin²,

Rast³

2019

Preprint

View full text Add to dashboard Cite

show abstract

“…In certain tasks the “stability of instability” has been shown to have adequate, and in some cases, excellent retest reliability (Fleming, Steiborn, Langner, Scholz, & Westhoff, 2007 ; Saville et al, 2011 ). This points towards a possible disconnect between methodological and substantive inquires, in that, for the latter, intra individual variation (IIV) is often studied in these same tasks (Duchek, Balota, Tse, Holtzman, Fagan, & Goate, 2009 ; Fehr, Wiechert, & Erhard, 2014 ; Kane et al, 2016 ). Second, and more generally, if a researcher is interested in individual differences, they have to at least approach the individual level.…”

Section: Discussionmentioning

confidence: 99%

Putting the individual into reliability: Bayesian testing of homogeneous within-person variance in hierarchical models

2021

View full text Add to dashboard Cite

Measurement reliability is a fundamental concept in psychology. It is traditionally considered a stable property of a questionnaire, measurement device, or experimental task. Although intraclass correlation coefficients (ICC) are often used to assess reliability in repeated measure designs, their descriptive nature depends upon the assumption of a common within-person variance. This work focuses on the presumption that each individual is adequately described by the average within-person variance in hierarchical models. And thus whether reliability generalizes to the individual level, which leads directly into the notion of individually varying ICCs. In particular, we introduce a novel approach, using the Bayes factor, wherein a researcher can directly test for homogeneous within-person variance in hierarchical models. Additionally, we introduce a membership model that allows for classifying which (and how many) individuals belong to the common variance model. The utility of our methodology is demonstrated on cognitive inhibition tasks. We find that heterogeneous within-person variance is a defining feature of these tasks, and in one case, the ratio between the largest to smallest within-person variance exceeded 20. This translates into a tenfold difference in person-specific reliability! We also find that few individuals belong to the common variance model, and thus traditional reliability indices are potentially masking important individual variation. We discuss the implications of our findings and possible future directions. The methods are implemented in the R package vICC

show abstract

“…They attribute the slower responses in the MRI setting to distracting factors (monotonous noise, horizontal position, see also ref. 66 ) causing a slowdown in late motor processes. Likewise, the error rates also demonstrated large differences (Cohen’s d > 1) between methods, especially for invalid conditions.…”

Section: Discussionmentioning

confidence: 99%

The effect of feature-based attention on flanker interference processing: An fMRI-constrained source analysis

Siemann

Herrmann

Galashan

2018

Sci Rep

View full text Add to dashboard Cite

The present study examined whether feature-based cueing affects early or late stages of flanker conflict processing using EEG and fMRI. Feature cues either directed participants’ attention to the upcoming colour of the target or were neutral. Validity-specific modulations during interference processing were investigated using the N200 event-related potential (ERP) component and BOLD signal differences. Additionally, both data sets were integrated using an fMRI-constrained source analysis. Finally, the results were compared with a previous study in which spatial instead of feature-based cueing was applied to an otherwise identical flanker task. Feature-based and spatial attention recruited a common fronto-parietal network during conflict processing. Irrespective of attention type (feature-based; spatial), this network responded to focussed attention (valid cueing) as well as context updating (invalid cueing), hinting at domain-general mechanisms. However, spatially and non-spatially directed attention also demonstrated domain-specific activation patterns for conflict processing that were observable in distinct EEG and fMRI data patterns as well as in the respective source analyses. Conflict-specific activity in visual brain regions was comparable between both attention types. We assume that the distinction between spatially and non-spatially directed attention types primarily applies to temporal differences (domain-specific dynamics) between signals originating in the same brain regions (domain-general localization).

show abstract

Variability in color-choice Stroop performance within and across EEG and MRI laboratory contexts

Cited by 7 publications

References 24 publications

Putting the Individual into Reliability: Bayesian Testing of Homogeneous Within-Person Variance in Hierarchical Models

Putting the Individual into Reliability: Bayesian Testing of Homogeneous Within-Person Variance in Hierarchical Models

Putting the individual into reliability: Bayesian testing of homogeneous within-person variance in hierarchical models

The effect of feature-based attention on flanker interference processing: An fMRI-constrained source analysis

Contact Info

Product

Resources

About