Participant Nonnaiveté and the reproducibility of cognitive psychology

Zwaan, Rolf A.; Pecher, Diane; Paolacci, Gabriele; Bouwmeester, Samantha; Verkoeijen, Peter P. J. L.; Dijkstra, Katinka; Zeelenberg, René

doi:10.3758/s13423-017-1348-y

Cited by 96 publications

(103 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…findings. This finding is in line with research showing that online psychology studies are effective in these environments (Zwaan et al, 2017), and online studies have the key benefits of allowing efficient collection of larger participant pools.…”

Section: Experiments 2 Discussionsupporting

confidence: 88%

A broader application of the detection response task to cognitive tasks and online environments

Innes¹,

Evans²,

Howard³

et al. 2019

Preprint

View full text Add to dashboard Cite

The accurate and objective measurement of cognitive workload is important in many aspects of psychological research. The Detection Response Task (DRT) is a well-validated method for measuring cognitive workload that has been used extensively in applied tasks, for example to investigate the effects of fatigue and phone usage on driving. Given its success in applied tasks, we investigated whether the DRT could be used to measure cognitive workload in cognitive tasks more commonly used in experimental cognitive psychology, and whether this application could be extended to online environments. We had participants perform a multiple object tracking task while simultaneously performing a DRT. We manipulated the cognitive load of the multiple object tracking task by changing the number of dots to be tracked. Measurements from the DRT were sensitive to changes in the cognitive load, establishing the efficacy of the DRT for experimental cognitive tasks in lab-based situations. This sensitivity continued when applied to an online environment (with our code for the online DRT implementation being freely available at \url{https://osf.io/dc39s/}), though to a reduced extent compared to the in-lab situation, opening up the potential use of the DRT to a much greater range of tasks and situations, but suggesting that in-lab applications are best when possible.

show abstract

Section: Experiments 2 Discussionsupporting

confidence: 88%

A broader application of the detection response task to cognitive tasks and online environments

Innes¹,

Evans²,

Howard³

et al. 2019

Preprint

View full text Add to dashboard Cite

show abstract

“…Our study also adds to the literature assessing false memory performance in autism. The false memory illusion is a robust effect in the general population [Zwaan et al, ], but the evidence for reduced susceptibility to false memories in people with autism is less compelling, with Hillier et al [] and Bowler et al [] both failing to replicate the effect in verbal false memory tasks. Our study offers some insight into these apparently conflicting results.…”

Section: Discussionmentioning

confidence: 99%

Visual Motion Prediction and Verbal False Memory Performance in Autistic Children

2017

View full text Add to dashboard Cite

Recent theoretical accounts propose that atypical predictive processing can explain the diverse cognitive and behavioral features associated with autism, and that difficulties in making predictions may be related to reduced contextual processing. In this pre‐registered study, 30 autistic children aged 6–14 years and 30 typically developing children matched in age and non‐verbal IQ completed visual extrapolation and false memory tasks to assess predictive abilities and contextual processing, respectively. In the visual extrapolation tasks, children were asked to predict when an occluded car would reach the end of a road and when an occluded set of lights would fill up a grid. Autistic children made predictions that were just as precise as those made by typically developing children, across a range of occlusion durations. In the false memory task, autistic and typically developing children did not differ significantly in their discrimination between items presented in a list and semantically related, non‐presented items, although the data were insensitive, suggesting the need for larger samples. Our findings help to refine theoretical accounts by challenging the notion that autism is caused by pervasively disordered prediction abilities. Further studies will be required to assess the relationship between predictive processing and context use in autism, and to establish the conditions under which predictive processing may be impaired. Autism Res 2018, 11: 509–518. © 2017 The Authors Autism Research published by International Society for Autism Research and Wiley Periodicals, Inc.Lay SummaryIt has been suggested that autistic individuals have difficulties making predictions and perceiving the overall gist of things. Yet, here we found that autistic children made similar predictions about hidden objects as non‐autistic children. In a memory task, autistic children were slightly less confused about whether they had heard a word before, when words were closely related in meaning. We conclude that autistic children do not show difficulties with this type of prediction.

show abstract

“…The accuracy cut off was used to exclude blocks in which we assumed that participants were not attending to the task, and were guessing (i.e., responding randomly); guessing would be indicated by scores close to chance. It is common practice in cognitive control studies to apply an accuracy cut off for this reason (e.g., De Simoni & von Bastian, 2018;Kane, Poole, Tuholski & Engle, 2006;Rey-Mermet, Gade & Oberauer, 2018;Zwaan et al, 2017). The 60% accuracy cut off in the current study resulted in four participants in the group with DS and two participants in the TD group missing data from either the low or high memory load conditions.…”

Section: Accuracy Cut Offmentioning

confidence: 79%

A Novel Framework to Measure Executive Function in Down Syndrome With Applications for Early Clinical Diagnosis of Dementia

Smith

Hedge

Jarrold

2019

American Journal on Intellectual and Developmental Disabilities

View full text Add to dashboard Cite

Executive function (EF) decline is a consistent early sign of Alzheimer's disease (AD) among adults with Down syndrome (DS), which means that baseline measures of EF for individuals with DS are vital to allow detection of meaningful decline. We developed a framework to extract measures of three core components of EF (memory updating, inhibitory, and temporal components) within one task. Increases in memory load, inhibitory load, and temporal demands led to significant increases in reaction times and significant decreases in accuracy among 18 adults with DS and 18 typically developing matched individuals; thus, the expected effects of all three manipulations were detected. Good test-retest reliability indicated that this framework has the potential to provide a simple, baseline EF measure for individuals with DS.

show abstract

Participant Nonnaiveté and the reproducibility of cognitive psychology

Cited by 96 publications

References 24 publications

A broader application of the detection response task to cognitive tasks and online environments

A broader application of the detection response task to cognitive tasks and online environments

Visual Motion Prediction and Verbal False Memory Performance in Autistic Children

A Novel Framework to Measure Executive Function in Down Syndrome With Applications for Early Clinical Diagnosis of Dementia

Contact Info

Product

Resources

About