SummaryData analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed.
Individuals’ risk attitudes are known to guide choices about uncertain options. However, in the presence of others’ decisions, these choices can be swayed and manifest as riskier or safer behavior than one would express alone. To test the mechanisms underlying effective social ‘nudges’ in human decision-making, we used functional neuroimaging and a task in which participants made choices about gambles alone and after observing others’ selections. Against three alternative explanations, we found that observing others’ choices of gambles increased the subjective value (utility) of those gambles for the observer. This ‘other-conferred utility’ was encoded in ventromedial prefrontal cortex, and these neural signals predicted conformity. We further identified a parametric interaction with individual risk preferences in anterior cingulate cortex and insula. These data provide a neuromechanistic account of how information from others is integrated with individual preferences that may explain preference-congruent susceptibility to social signals of safety and risk.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.