Designing and evaluating tasks to measure individual differences in experimental psychology: a tutorial

Brysbaert, Marc

doi:10.1186/s41235-024-00540-2

Cited by 3 publications

(1 citation statement)

References 114 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…So, each of the seven constructs (objective and subjective emotion perception, crystallized intelligence, social confidence, feelings of loneliness, interest in people vs. things, and reading pleasure) were measured with at least two tests, to make sure that we had the best possible estimate of the correlations between the constructs (latent variables) rather than the correlations between individual tests. This allowed us to investigate the correlation between the construct of subjective emotion perception and the construct of objective emotion perception (rather than the correlation between individual test) and the correlations of these two constructs with the other five constructs (Brysbaert, 2024;Hodson, 2021;Völker, 2020).…”

Section: Convergent and Discriminant Validitymentioning

confidence: 99%

Towards understanding the low correlation between subjective and performance-based measures of emotion perception: Is one measure better than the other?

Hendel,

Brysbaert

2024

Preprint

View full text Add to dashboard Cite

This study examined the construct validity of performance-based emotion recognition tests. We recruited 227 adults (30-60 years old) through Prolific to complete four emotion recognition tasks in addition to measures of self-reported emotion recognition, crystallized intelligence, social confidence, loneliness/well-being, interest in people versus things, and reading enjoyment (all measured with at least two indicators). Consistent with previous research, objective emotion recognition tasks were positively correlated and formed a separate cluster. This cluster correlated with crystallized intelligence but not with self-reported emotion recognition, loneliness/well-being, interest in people vs. things, or reading pleasure. Interestingly, there appeared to be a negative correlation with social self-confidence, suggesting that people who performed well on emotion recognition tasks had less social self-confidence. This is consistent with the possibility that hypersensitivity to social cues may have disadvantages. Conversely, self-reported skill in recognizing emotions correlated highly with social self-confidence and loneliness/well-being, at least in a context where no clear advantage existed for specific response patterns. Overall, our findings suggest that the objective tests primarily assessed intelligence rather than broader social-emotional functioning. In brief, this study highlights the importance of selecting appropriate measures when evaluating individuals’ emotional intelligence.

show abstract

Section: Convergent and Discriminant Validitymentioning

confidence: 99%

Towards understanding the low correlation between subjective and performance-based measures of emotion perception: Is one measure better than the other?

Hendel,

Brysbaert

2024

Preprint

View full text Add to dashboard Cite

show abstract

A behavioural exploration of language aptitude and experience, cognition and more using Graph Analysis

Rampinini,

Balboni,

Golestani

et al. 2024

Brain Research

View full text Add to dashboard Cite

Reliably measuring learning-dependent distractor suppression with eye tracking

Kim,

Grégoire,

Anderson

2024

Behav Res

View full text Add to dashboard Cite

In the field of psychological science, behavioral performance in computer-based cognitive tasks often exhibits poor reliability. The absence of reliable measures of cognitive processes contributes to non-reproducibility in the field and impedes the investigation of individual differences. Specifically in visual search paradigms, response time-based measures have shown poor test–retest reliability and internal consistency across attention capture and distractor suppression, but one study has demonstrated the potential for oculomotor measures to exhibit superior reliability. Therefore, in this study, we investigated three datasets to compare the reliability of learning-dependent distractor suppression measured via distractor fixations (oculomotor capture) and latency to fixate the target (fixation times). Our findings reveal superior split-half reliability of oculomotor capture compared to that of fixation times regardless of the critical distractor comparison, with the reliability of oculomotor capture in most cases falling within the range that is acceptable for the investigation of individual differences. We additionally find that older adults have superior oculomotor reliability compared with young adults, potentially addressing a significant limitation in the aging literature of high variability in response time measures due to slower responses. Our findings highlight the utility of measuring eye movements in the pursuit of reliable indicators of distractor processing and the need to further test and develop additional measures in other sensory domains to maximize statistical power, reliability, and reproducibility.

show abstract

Designing and evaluating tasks to measure individual differences in experimental psychology: a tutorial

Cited by 3 publications

References 114 publications

Towards understanding the low correlation between subjective and performance-based measures of emotion perception: Is one measure better than the other?

Towards understanding the low correlation between subjective and performance-based measures of emotion perception: Is one measure better than the other?

A behavioural exploration of language aptitude and experience, cognition and more using Graph Analysis

Reliably measuring learning-dependent distractor suppression with eye tracking

Contact Info

Product

Resources

About