No Evidence for Consistent Reliability Across 36 Variations of the Emotional Dot Probe Task in 9,000 participants

Xu, Irene; Passell, Eliza; Strong, Roger; Grinspoon, Liz; Wu, Christina Y; Jung, Laneé; Wilmer, Jeremy; Germine, Laura

doi:10.31234/osf.io/58z4n

Cited by 4 publications

(1 citation statement)

References 49 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One barrier to this, however, is growing concerns that many of the most commonly used cognitive tests in psychiatry suffer from poor reliability 28,29 . This is in contrast to self-report clinical questionnaires, which typically demonstrate good to excellent reliability 30,31 .…”

Section: Introductionmentioning

confidence: 99%

Reliable, rapid, and remote measurement of metacognitive bias

Fox,

McDonogh,

Donegan

et al. 2023

Preprint

View full text Add to dashboard Cite

Metacognitive biases have been repeatedly associated with transdiagnostic psychiatric dimensions of ‘anxious-depression’ and ‘compulsivity and intrusive thought’, cross-sectionally. To progress our understanding of the underlying neurocognitive mechanisms, new methods are required to measure metacognition remotely, within individuals over time. We developed a gamified smartphone task designed to measure metacognitive (confidence) bias and investigated its psychometric properties across two studies (N=3410 unpaid citizen scientists, N=52 paid participants). We assessed convergent validity, split-half and test-retest reliability, and identified the minimum number of trials required to capture its clinical correlates. Convergent validity of metacognitive bias was moderate (r(50)=0.64, p<0.001) and it demonstrated excellent split-half reliability (r(50)=0.91, p<0.001). Test-retest reliability was also very high (ICC=0.86, N=110). Anxious-depression was associated with decreased confidence (B=-0.23, SE=0.02, p<0.001), while compulsivity and intrusive thought was associated with greater confidence (B=0.07, SE=0.02, p<0.001). Metacognitive biases in decision-making are highly stable within-session, exhibiting strong reliability and associations with clinical correlates are evident in as few as 40 trials. Meta Mind exemplifies how to adapt established cognitive tasks for within-person, longitudinal assessments in computational psychiatry, facilitating the development and testing of causal models.

show abstract

Section: Introductionmentioning

confidence: 99%

Reliable, rapid, and remote measurement of metacognitive bias

Fox,

McDonogh,

Donegan

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

Maternal Trauma and Psychopathology Symptoms Affect Refugee Children’s Mental Health But Not Their Emotion Processing

Michalek,

Qtaishat,

von Stumm

et al. 2024

Res Child Adolesc Psychopathol

View full text Add to dashboard Cite

Refugee children’s development may be affected by their parents’ war-related trauma exposure and psychopathology symptoms across a range of cognitive and affective domains, but the processes involved in this transmission are poorly understood. Here, we investigated the impact of refugee mothers’ trauma exposure and mental health on their children’s mental health and attention biases to emotional expressions. In our sample of 324 Syrian refugee mother-child dyads living in Jordan (children’s Mage=6.32, SD = 1.18; 50% female), mothers reported on their symptoms of anxiety and depression, and on their children’s internalising, externalising, and attention problems. A subset of mothers reported their trauma exposure (n = 133) and PTSD symptoms (n = 124). We examined emotion processing in the dyads using a standard dot-probe task measuring their attention allocation to facial expressions of anger and sadness. Maternal trauma and PTSD symptoms were linked to child internalising and attention problems, while maternal anxiety and depression symptoms were associated with child internalising, externalising, and attention problems. Mothers and children were hypervigilant towards expressions of anger, but surprisingly, mother and child biases were not correlated with each other. The attentional biases to emotional faces were also not linked to psychopathology risk in the dyads. Our findings highlight the importance of refugee mothers’ trauma exposure and psychopathology on their children’s wellbeing. The results also suggest a dissociation between the mechanisms underlying mental health and those involved in attention to emotional faces, and that intergenerational transmission of mental health problems might involve mechanisms other than attentional processes relating to emotional expressions.

show abstract

Reliable, rapid, and remote measurement of metacognitive bias

Fox,

McDonogh,

Donegan

et al. 2024

Sci Rep

View full text Add to dashboard Cite

Metacognitive biases have been repeatedly associated with transdiagnostic psychiatric dimensions of ‘anxious-depression’ and ‘compulsivity and intrusive thought’, cross-sectionally. To progress our understanding of the underlying neurocognitive mechanisms, new methods are required to measure metacognition remotely, within individuals over time. We developed a gamified smartphone task designed to measure visuo-perceptual metacognitive (confidence) bias and investigated its psychometric properties across two studies (N = 3410 unpaid citizen scientists, N = 52 paid participants). We assessed convergent validity, split-half and test–retest reliability, and identified the minimum number of trials required to capture its clinical correlates. Convergent validity of metacognitive bias was moderate (r(50) = 0.64, p < 0.001) and it demonstrated excellent split-half reliability (r(50) = 0.91, p < 0.001). Anxious-depression was associated with decreased confidence (β = − 0.23, SE = 0.02, p < 0.001), while compulsivity and intrusive thought was associated with greater confidence (β = 0.07, SE = 0.02, p < 0.001). The associations between metacognitive biases and transdiagnostic psychiatry dimensions are evident in as few as 40 trials. Metacognitive biases in decision-making are stable within and across sessions, exhibiting very high test–retest reliability for the 100-trial (ICC = 0.86, N = 110) and 40-trial (ICC = 0.86, N = 120) versions of Meta Mind. Hybrid ‘self-report cognition’ tasks may be one way to bridge the recently discussed reliability gap in computational psychiatry.

show abstract

No Evidence for Consistent Reliability Across 36 Variations of the Emotional Dot Probe Task in 9,000 participants

Cited by 4 publications

References 49 publications

Reliable, rapid, and remote measurement of metacognitive bias

Reliable, rapid, and remote measurement of metacognitive bias

Maternal Trauma and Psychopathology Symptoms Affect Refugee Children’s Mental Health But Not Their Emotion Processing

Reliable, rapid, and remote measurement of metacognitive bias

Contact Info

Product

Resources

About