A Secondary Replication Attempt of Stereotype Susceptibility ()

Abstract

<jats:p> Prior work suggests that awareness of stereotypes about a person’s in-group can affect a person’s behavior and performance when they complete a stereotype-relevant task, a phenomenon called stereotype susceptibility ( Shih, Pittinsky, &amp; Ambady, 1999 ). In a preregistered confirmatory design, we found that priming Asian women with social identities associated with math stereotypes did not influence their performance on a subsequent mathematics exam, and hypothesized moderators did not account for the effect. The conditions necessary to obtain the original results are not yet fully understood. </jats:p>

The influence of gender stereotype threat on mathematics test scores of Dutch high school students: a registered report

“…With this study, we started an effort to testing stereotype threat effects in a confirmatory fashion using a meticulous design. Other efforts to improve the replicability of stereotype threat studies, like high powered studies (Smeding, Dumas, Loose, & Régner, 2013;Stricker & Ward, 2004), additional pre-registered replication studies (Finnigan & Corker, 2016;Gibson et al, 2014;Moon & Roeder, 2014) are now starting to appear. We hope this trend will continue in the future, and might extend to other exciting formats like adversarial collaborations to replicate some of the original stereotype threat findings.…”

“…Three methodological and statistical issues in the replicability debate (Asendorpf et al, 2013) are particularly relevant for stereotype threat research: pre-registration, a priori power analyses and multilevel analysis. First, pre-registration has received little attention in articles on stereotype threat (for exceptions, see Finnigan & Corker, 2016;Gibson, Losee, & Vitiello, 2014;Moon & Roeder, 2014). There are several upsides to pre-registered studies.…”

Are most published social psychological findings false?

“…The disappointing replication rate of single studies does not mean, however, that our journals 7 For some reason, one study was replicated twice. Whereas Gibson, Losee, and Vitielleo (2014) succeeded in replicating the stereotype susceptibility effect of Shih, Pittinsky, and Ambady (1999), a second replication by Moon and Roeder (2014) commissioned later failed to replicate the effect. In a response to these two replications, Shih and Pittinsky (2014) suggested various reasons for this discrepancy, which were then denied by Moon and Roeder in their response to the comments of Shih and Pittinsky (2014).…”

Registered Reports

“…Ultimately 14 proposals were accepted. A 15th article (Moon & Roeder, 2014) was solicited as a second replication of one of the peer reviewed, accepted proposals (Gibson, Losee, & Vitiello, 2014) because reviewers suggests that the effect may not occur among Asian women at southern US universities (Gibson et al's sample).…”