Statistical thresholding (i.e. P-values) in fMRI research has become increasingly conservative over the past decade in an attempt to diminish Type I errors (i.e. false alarms) to a level traditionally allowed in behavioral science research. In this article, we examine the unintended negative consequences of this single-minded devotion to Type I errors: increased Type II errors (i.e. missing true effects), a bias toward studying large rather than small effects, a bias toward observing sensory and motor processes rather than complex cognitive and affective processes and deficient meta-analyses. Power analyses indicate that the reductions in acceptable P-values over time are producing dramatic increases in the Type II error rate. Moreover, the push for a mapwide false discovery rate (FDR) of 0.05 is based on the assumption that this is the FDR in most behavioral research; however, this is an inaccurate assessment of the conventions in actual behavioral research. We report simulations demonstrating that combined intensity and cluster size thresholds such as P < 0.005 with a 10 voxel extent produce a desirable balance between Types I and II error rates. This joint threshold produces high but acceptable Type II error rates and produces a FDR that is comparable to the effective FDR in typical behavioral science articles (while a 20 voxel extent threshold produces an actual FDR of 0.05 with relatively common imaging parameters). We recommend a greater focus on replication and meta-analysis rather than emphasizing single studies as the unit of analysis for establishing scientific truth. From this perspective, Type I errors are self-erasing because they will not replicate, thus allowing for more lenient thresholding to avoid Type II errors.
Abstract& We used fMRI to explore the neural substrates involved in the unconscious evaluation of Black and White social groups. Specifically, we focused on the amygdala, a subcortical structure known to play a role in emotional learning and evaluation. In Experiment 1, White American subjects observed faces of unfamiliar Black and White males. The strength of amygdala activation to Black-versus-White faces was correlated with two indirect (unconscious) measures of race evaluation (Implicit Association Test [IAT] and potentiated startle), but not with the direct (conscious) expression of race attitudes. In Experiment 2, these patterns were not obtained when the stimulus faces belonged to familiar and positively regarded Black and White individuals. Together, these results suggest that amygdala and behavioral responses to Black-versus-White faces in White subjects reflect cultural evaluations of social groups modified by individual experience. &
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.