In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to decide quickly than when forced to delay their decision (Rand, Greene & Nowak, 2012), a pattern consistent with the social heuristics hypothesis proposed by Rand and colleagues. The results of studies using time pressure have been mixed, with some replication attempts observing similar patterns (e.g., and others observing null effects (e.g., Tinghög et al., 2013;Verkoeijen & Bouwmeester, 2014). This Registered Replication Report (RRR) assessed the size and variability of the effect of time pressure on cooperative decisions by combining 21 separate, preregistered replications of the critical conditions from Study 7 of the original article (Rand et al., 2012). The primary planned analysis used data from all participants who were randomly assigned to conditions and who met the protocol inclusion criteria (an intent-to-treat approach that included the 65.9% of participants in the time-pressure condition and 7.5% in the forced-delay condition who did not adhere to the time constraints), and we observed a difference in contributions of −0.37 percentage points compared with an 8.6 percentage point difference calculated from the original data. Analyzing the data as the original article did, including data only for participants who complied with the time constraints, the RRR observed a 10.37 percentage point difference in contributions compared with a 15.31 percentage point difference in the original study. In combination, the results of the intent-to-treat analysis and the compliant-only analysis are consistent with the presence of selection biases and the absence of a causal effect of time pressure on cooperation.

Many argue that there is a reproducibility crisis in psychology. We investigated nine well-known effects from the cognitive psychology literature-three each from the domains of perception/action, memory, and language, respectively-and found that they are highly reproducible. Not only can they be reproduced in online environments, but they also can be reproduced with nonnaïve participants with no reduction of effect size. Apparently, some cognitive tasks are so constraining that they encapsulate behavior from external influences, such as testing situation and prior recent experience with the experiment to yield highly robust effects.

Recently, researchers claimed that people are intuitively inclined to cooperate with reflection causing them to behave selfishly. Empirical support for this claim came from experiments using a 4-player public goods game with a marginal return of 0.5 showing that people contributed more money to a common project when they had to decide quickly (i.e., a decision based on intuition) than when they were instructed to reflect and decide slowly. This intuitive-cooperation effect is of high scientific and practical importance because it argues against a central assumption of traditional economic and evolutionary models. The first experiment of present study was set up to examine the generality of the intuitive-cooperation effect and to further validate the experimental task producing the effect. In Experiment 1, we investigated Amazon Mechanical Turk (AMT) workers' contributions to a 4-player public goods game with a marginal return of 0.5 while we manipulated the knowledge about the other players' contribution to the public goods game (contribution known vs. contribution unknown), the identity of the other players (humans vs. computers randomly generating contributions) and the time constraint (time pressure/intuition vs. forced delay/reflection). However, the results of Experiment 1 failed to reveal an intuitive-cooperation effect. Furthermore, four subsequent direct replications attempts with AMT workers (Experiments 2a, 2b, 2c and Experiment 3, which was conducted with naïve/inexperienced participants) also failed to demonstrate intuitive-cooperation effects. Taken together, the results of the present study could not corroborate the idea that people are intuitively cooperative, hence suggesting that the theoretical relationship between intuition and cooperation should be further scrutinized.

The research method of collecting free essays and utilising correspondence analysis to represent conceptual items and groups of participants seems promising as long as a theoretical framework is available to interpret the resulting representation of similarities between items and groups of participants.

No abstract