52% Yes, a signiicant crisis 3% No, there is no crisis 7% Don't know 38% Yes, a slight crisis 38% Yes, a slight crisis 1,576 RESEARCHERS SURVEYED M ore than 70% of researchers have tried and failed to reproduce another scientist's experiments, and more than half have failed to reproduce their own experiments. Those are some of the telling figures that emerged from Nature's survey of 1,576 researchers who took a brief online questionnaire on reproducibility in research. The data reveal sometimes-contradictory attitudes towards reproduc-ibility. Although 52% of those surveyed agree that there is a significant 'crisis' of reproducibility, less than 31% think that failure to reproduce published results means that the result is probably wrong, and most say that they still trust the published literature. Data on how much of the scientific literature is reproducible are rare and generally bleak. The best-known analyses, from psychology 1 and cancer biology 2 , found rates of around 40% and 10%, respectively. Our survey respondents were more optimistic: 73% said that they think that at least half of the papers in their field can be trusted, with physicists and chemists generally showing the most confidence. The results capture a confusing snapshot of attitudes around these issues, says Arturo Casadevall, a microbiologist at the Johns Hopkins Bloomberg School of Public Health in Baltimore, Maryland. "At the current time there is no consensus on what reproducibility is or should be. " But just recognizing that is a step forward, he says. "The next step may be identifying what is the problem and to get a consensus. "

Many methods for reducing implicit prejudice have been identified, but little is known about their relative effectiveness. We held a research contest to experimentally compare interventions for reducing the expression of implicit racial prejudice. Teams submitted seventeen interventions that were tested an average of 3.70 times each in four studies (total N = 17,021), with rules for revising interventions between studies. Eight of seventeen interventions were effective at reducing implicit preferences for Whites compared to Blacks, particularly ones that provided experience with counterstereotypical exemplars, used evaluative conditioning methods, and provided strategies to override biases. The other nine interventions were ineffective, particularly ones that engaged participants with others' perspectives, asked participants to consider egalitarian values, or induced a positive emotion. The most potent interventions were ones that invoked high self-involvement or linked Black people with positivity and White people with negativity. No intervention consistently reduced explicit racial preferences. Furthermore, intervention effectiveness only weakly extended to implicit preferences for Asians and Hispanics. Abstract = 160 words Keywords = attitudes, racial prejudice, implicit social cognition, malleability, Implicit Association Test September 9, 2016 update: We updated this manuscript to fix several minor reporting errors that we have learned about since the publication of the manuscript in August 2014. For a summary of these updates, please see pages 67 and 68. Authors' note:This project was supported by a gift from Project Implicit. Lai and Hawkins are consultants and Nosek is an officer of Project Implicit, Inc., a non-profit organization that includes in its mission "To develop and deliver methods for investigating and applying phenomena of implicit social cognition, including especially phenomena of implicit bias based on age, race, gender or other factors. Thoughts and feelings outside of conscious awareness shape social perception, judgment and action (Bargh, 1999;Devine, 1989;Greenwald & Banaji, 1995). Nowhere has this idea been more explored than in studies of racial prejudice in which people report egalitarian racial attitudes, but also implicitly prefer Whites compared to Blacks (Devine, 1989;Dovidio, Kawakami, Johnson, Johnson, & Howard, 1997;Fazio, Jackson, Dunton, & Williams, 1995;. These studies have been influential because implicit racial preferences predict behaviors such as negative interracial contact (McConnell & Leibold, 2001), biases in medical decision-making (Green et al., 2007), and hiring discrimination (Rooth, 2010).From the hundreds of studies conducted, we can conclude that implicit preferences (1) are related to, but distinct from, explicit preferences (Greenwald & Banaji, 1995;, (2) are constructed through different mechanisms than explicit preferences (De Houwer, Teige-Mocigemba, Spruyt, & Moors, 2009;Ranganath & Nosek, 2008;Ratliff & Nosek, 2011;Rydell & McConnell, 2006), ...

Implicit preferences are malleable, but does that change last? We tested nine interventions (eight real and one sham) to reduce implicit racial preferences over time. In two studies with a total of 6,321 participants, all nine interventions immediately reduced implicit preferences. However, none were effective after a delay of several hours to several days. We also found that these interventions did not change explicit racial preferences and were not reliably moderated by motivations to respond without prejudice. Short-term malleability in implicit preferences does not necessarily lead to long-term change, raising new questions about the flexibility and stability of implicit preferences.Word Count: 100 Keywords: attitudes, racial prejudice, implicit social cognition, malleability, Implicit Association Test Full CitationLai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, M., Devos, T., Calanchini, J., Xiao, Y. J., Pedram, C., Marshburn, C. K., Simon, S., Blanchar, J. C., Joy-Gaba, J. A., Conway, J., Redford, L., Klein, R. A., Roussos, G., Schellhaas, F. M. H., Burns, M., Hu, X., McLean, M. C., Axt, J. R., Asgari, S., Schmidt, K., Rubinstein., R, Marini, M., Rubichi, S., Shin,. J. L., & Nosek, B. A. (2016). Reducing implicit racial preferences: II. Intervention effectiveness across time. Journal of Experimental Psychology: General, 145, 1001-1016. REDUCING IMPLICIT RACIAL PREFERENCES 3 Reducing Implicit Racial Preferences: II. Intervention Effectiveness Across TimeEarly theories of implicit social cognition suggested that implicit associations were largely stable. These claims were supported by evidence that changes in conscious belief did not lead to corresponding changes in implicit associations (e.g., Devine, 1989;Wilson, Lindsey, & Schooler, 2000). The psychologist John Bargh referred to the stability of implicit cognitions as the "cognitive monster": "Once a stereotype is so entrenched that it becomes activated automatically, there is really little that can be done to control its influence" (p. 378, Bargh, 1999). This dominant view has changed over the past fifteen years to one of implicit malleability, with many studies finding that implicit associations are sensitive to lab-based interventions (for reviews, see Blair, 2002;Gawronski & Bodenhausen 2006;Lai, Hoffman, & Nosek, 2013). These interventions vary greatly in approach. In one, for example, participants are exposed to images of people who defy stereotypes (e.g., admired Black people / hated White people; Joy-Gaba & Nosek, 2010). In another, participants are given goals to override implicit biases (e.g., Mendoza, Gollwitzer, & Amodio, 2010;Stewart & Payne, 2008).In most of the research on implicit association change, the short-term malleability of associations is tested by administering an implicit measure immediately after the intervention. Studies examining long-term change in implicit associations are rare. In a meta-analysis on experiments to change implicit associations (Forscher, Lai, et al., 2016), only 22 (3.7%) of 585 studies ...

Using a novel technique known as network meta-analysis, we synthesized evidence from 492 studies (87,418 participants) to investigate the effectiveness of procedures in changing implicit measures, which we define as response biases on implicit tasks. We also evaluated these procedures' effects on explicit and behavioral measures. We found that implicit measures can be changed, but effects are often relatively weak (|ds| < .30). Most studies focused on producing short-term changes with brief, single-session manipulations. Procedures that associate sets of concepts, invoke goals or motivations, or tax mental resources changed implicit measures the most, whereas procedures that induced threat, affirmation, or specific moods/emotions changed implicit measures the least. Bias tests suggested that implicit effects could be inflated relative to their true population values. Procedures changed explicit measures less consistently and to a smaller degree than implicit measures and generally produced trivial changes in behavior. Finally, changes in implicit measures did not mediate changes in explicit measures or behavior. Our findings suggest that changes in implicit measures are possible, but those changes do not necessarily translate into changes in explicit measures or behavior.

In the last 20 years, research on implicit social cognition has established that social judgments and behavior are guided by attitudes and stereotypes of which the actor may lack awareness. Research using the methods of implicit social cognition has produced the concept of implicit bias, which has generated wide attention not only in social, clinical, and developmental psychology, but also in disciplines outside of psychology, including business, law, criminal justice, medicine, education, and political science. Although this rapidly growing body of research offers prospects of useful societal applications, the theory needed to confidently guide those applications remains insufficiently developed. This article describes the methods that have been developed, the findings that have been obtained, and the theoretical questions that remain to be answered.