Pre-registration in social psychology—A discussion and suggested template

Veer, Anna Elisabeth van 't; Giner‐Sorolla, Roger

doi:10.1016/j.jesp.2016.03.004

Cited by 322 publications

(149 citation statements)

References 62 publications

Supporting

Mentioning

133

Contrasting

Unclassified

Order By: Relevance

“…There are also guidelines for improving the reporting of research planning; for example, the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement for reporting of systematic reviews and meta-analyses 59 , and PRISMA-P for protocols of systematic reviews 60 . The Preregistration Challenge workflow and the pre-registration recipe for social-behavioural research 61 also illustrate guidelines for reporting research plans.…”

Section: Perspective Nature Human Behaviourmentioning

confidence: 99%

A manifesto for reproducible science

et al. 2017

View full text Add to dashboard Cite

Improving the reliability and efficiency of scientific research will increase the credibility of the published scientific literature and accelerate discovery. Here we argue for the adoption of measures to optimize key elements of the scientific process: methods, reporting and dissemination, reproducibility, evaluation and incentives. There is some evidence from both simulations and empirical studies supporting the likely effectiveness of these measures, but their broad adoption by researchers, institutions, funders and journals will require iterative evaluation and improvement. We discuss the goals of these measures, and how they can be implemented, in the hope that this will facilitate action toward improving the transparency, reproducibility and efficiency of scientific research.

show abstract

Section: Perspective Nature Human Behaviourmentioning

confidence: 99%

A manifesto for reproducible science

et al. 2017

View full text Add to dashboard Cite

show abstract

“…In other words, pre‐registration creates a clear separation between confirmatory and exploratory findings . Note, however, that pre‐registration can be done in different levels of detail and several pre‐registration formats and templates have been suggested . Strategic use of flexibility in analyses can only truly be avoided if the pre‐registration contains a high level of detail, but this is currently often not the case .…”

Section: Pre‐registrationmentioning

confidence: 99%

Practical tools and strategies for researchers to increase replicability

Nuijten

2018

Develop Med Child Neuro

View full text Add to dashboard Cite

A growing body of evidence indicates that the effects reported in many scientific fields may be overestimated or even false. This problem has gained a lot of attention in the field of psychology, where researchers have even started to speak of a ‘replication crisis’. Fortunately, a number of measures to rectify this problem have already been proposed and implemented, some inspired by practices in other scientific fields. In this review, I briefly examine this issue in the field of psychology and suggest some practical tools and strategies that researchers can implement to increase replicability and the overall quality of their scientific research. What this paper adds Researchers can implement many practical tools and strategies to improve replicability of their findings. Strategies include improving statistical inference, pre‐registration, multisite collaboration, and sharing data. Different scientific fields could benefit from looking at each other's best practices.

show abstract

“…In other words, preregistration creates a clear separation between confirmatory and exploratory findings . Note, however, that preregistration can be done in different levels of detail , and several preregistration formats and templates have been suggested (e.g., Van 't Veer & Giner-Sorolla, 2016; for an overview, see Veldkamp, Bakker, et al, 2017). Researcher degrees of freedom can only truly be avoided, if the preregistration contains a high level of detail, and this is currently often not the case (Veldkamp, Bakker, et al, 2017).…”

Section: Preregistrationmentioning

confidence: 99%

Research on Research: A Meta-Scientific Study of Problems and Solutions in Psychological Science

Nuijten¹

2018

Preprint

View full text Add to dashboard Cite

SUMMARY DOCTORAL DISSERTATION: Psychology is facing a “replication crisis”. Many psychological findings could not be replicated in novel samples, which lead to the growing concern that many published findings are overly optimistic or even false. In this dissertation, we investigated potential indicators of problems in the published psychological literature. In Part I of this dissertation, we looked at inconsistencies in reported statistical results in published psychology papers. To facilitate our research, we developed the free tool statcheck; a “spellchecker” for statistics. In Part II, we investigated bias in published effect sizes. We showed that in the presence of publication bias, the overestimation of effects can become worse if you combine studies. Indeed, in meta-analyses from the social sciences we found strong evidence that published effects are overestimated. These are worrying findings, and it is important to think about concrete solutions to improve the quality of psychological research. Some of the solutions we propose are preregistration, replication, and transparency. We argue that to select the best strategies to improve psychological science, we need research on research: meta-research.

show abstract

Pre-registration in social psychology—A discussion and suggested template

Abstract: The version in the Kent Academic Repository may differ from the final published version. Users are advised to check http://kar.kent.ac.uk for the status of the paper. Users should always cite the published version of record.

Cited by 322 publications

References 62 publications

A manifesto for reproducible science

A manifesto for reproducible science

Practical tools and strategies for researchers to increase replicability

Research on Research: A Meta-Scientific Study of Problems and Solutions in Psychological Science

Contact Info

Product

Resources

About