Data from a pre-publication independent replication initiative examining ten moral judgement effects

Abstract

We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory’s research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.

Scientific Utopia III: Crowdsourcing Science

“…Crowdsourcing is especially useful, we suggest, for fields that rely on local resources that can remain siloed. That said, the data corpus generated by crowdsourced projects often serves as a public resource after the publication of the article (e.g., Open Science Collaboration, 2015; Tierney et al, 2016).…”

Antihyperalgesic effects of Meteorin in the rat chronic constriction injury model: a replication study

“…Preclinical scientific research has been increasingly criticized for a lack of reproducibility. Recent publications 3,7,14,22,25,32 have demonstrated an alarmingly low level of reproducibility in biomedical research fields. In a survey of 1576 scientists, 1 more than 70% could not reproduce published results and more than 50% could not reproduce findings from their own experiments, leading to discussion of a “reproducibility crisis.” Data from psychology 22 and cancer biology 2 research showed only 40% and 11% of study results were reproducible, respectively.…”

Accelerated fetal growth in early pregnancy and risk of severe large‐for‐gestational‐age and macrosomic infant: a cohort study in a low‐risk population

“…The outcome measure was excessive infant birthweight defined as a severely LGA infant (birthweight greater than the 97th centile according to the sex‐specific Swedish reference curve for fetal growth) or macrosomia [birthweight of ≥4500 g at term (≥37 weeks)] . The core outcome set was not used because no relevant core outcome set has been developed .…”