Design issues and solutions for stop-signal data from the Adolescent Brain Cognitive Development (ABCD) study

Abstract

The Adolescent Brain Cognitive Development (ABCD) study is an unprecedented longitudinal neuroimaging sample that tracks the brain development of over 10,000 9-10 year olds through adolescence. At the core of this study are the three tasks that are completed repeatedly within the MRI scanner, one of which is the stop-signal task. In analyzing the available stopping experimental code and data, we identified a set of design issues that we believe significantly compromise its value. These issues include but are not limited to: variable stimulus durations that violate basic assumptions of dominant stopping models, trials in which stimuli are incorrectly not presented, and faulty stop-signal delays. We present eight issues, show their effect on the existing ABCD data, suggest prospective solutions including task changes for future data collection and preliminary computational models, and suggest retrospective solutions for data users who wish to make the most of the existing data.

A circuit-based approach to repair hypersexuality in Parkinson’s disease

“…Our ad-hoc behavioural task generated enhanced arousal in PD+HS patients while on- medication ( Table 2 ). Under the race stopping model, going and stopping are supposed to act independently 70 , confirmed in our data following recommended tests 40 , such as faster StopRespond reaction times compared to go trials ( Figure 1C ; Supplementary Material ). Group and medication effects modulated differently response inhibition [ Table S1 ; Figure 1B ; medication x group, F (2,44)=5.92, p =.006; group, F (2,44)=7.07, p =.002], where post-hoc tests showed significant medication effects in PD+HS [ t (12)=- 3.06, p =.01] with strong evidence that response inhibition was impaired by medication and sexual cues [ BF -0 = 11.60; see sequential analysis in Figure S2 ].…”

A protocol for working with open-source neuroimaging datasets

“… Investigate task timing; task regressors can fail to match overall task duration (as is the case for some subjects in the emotion task in the young adult HCP sample; http://protocols.humanconnectome.org/HCP/3T/task-fMRI-protocol-details.html ). Task stimuli may occasionally be missed or presented for different durations (as is the case for the stop-signal task in ABCD) ( Bissett et al., 2021 ). CRITICAL: Issues like these may or may not be reported with the data release.…”

“…Task stimuli may occasionally be missed or presented for different durations (as is the case for the stop-signal task in ABCD) ( Bissett et al., 2021 ).…”

Characterizing the Neural Correlates of Response Inhibition and Error Processing in Children With Symptoms of Irritability and/or Attention-Deficit/Hyperactivity Disorder in the ABCD Study®

“…The behavioral task measure of inhibition ability was Stop Signal reaction time (SSRT). To address experimental issues of SST noted previously (42), we estimated SSRT using the integration method, in which estimates were adjusted for behavioral parameters including successful inhibition rate, "Go" reaction time omissions, and premature responses on "Stop" trials.…”