The past, present, and future of Registered Reports

Chambers, Chris; Tzavella, Loukia

doi:10.31222/osf.io/43298

Cited by 78 publications

(106 citation statements)

References 46 publications

Supporting

Mentioning

104

Contrasting

Order By: Relevance

“…One impactful proposal was to separate confirmatory (hypothesis-testing) and exploratory (hypothesis-generating) research using preregistration (Wagenmakers et al, 2012). Many journals began to offer Registered Reports, a format in which peer review and publication decisions take place before data collection and analysis (Chambers & Tzavella, 2020). Because Registered Reports add peer review and editorial oversight to the preregistration process, they provide an even tighter seal against bias and error inflation.…”

Section: The Role Of the Hypothetico-deductive Methods In Psychology'smentioning

confidence: 99%

Why hypothesis testers should spend less time testing hypotheses

Scheel¹,

Tiokhin²,

Isager³

et al. 2020

Preprint

View full text Add to dashboard Cite

For almost half a century, Paul Meehl educated psychologists about how the mindless use of null-hypothesis significance tests made research on theories in the social sciences basically uninterpretable (Meehl, 1990). In response to the replication crisis, reforms in psychology have focused on formalising procedures for testing hypotheses. These reforms were necessary and impactful. However, as an unexpected consequence, psychologists have begun to realise that they may not be ready to test hypotheses. Forcing researchers to prematurely test hypotheses before they have established a sound ‘derivation chain’ between test and theory is counterproductive. Instead, various non-confirmatory research activities should be used to obtain the inputs necessary to make hypothesis tests informative. Before testing hypotheses, researchers should spend more time forming concepts, developing valid measures, establishing the causal relationships between concepts and their functional form, and identifying boundary conditions and auxiliary assumptions. Providing these inputs should be recognised and incentivised as a crucial goal in and of itself. In this article, we discuss how shifting the focus to non-confirmatory research can tie together many loose ends of psychology’s reform movement and help us lay the foundation to develop strong, testable theories, as Paul Meehl urged us to.

show abstract

Section: The Role Of the Hypothetico-deductive Methods In Psychology'smentioning

confidence: 99%

Why hypothesis testers should spend less time testing hypotheses

Scheel¹,

Tiokhin²,

Isager³

et al. 2020

Preprint

View full text Add to dashboard Cite

show abstract

“…An extended version of preregistration are registered reports (Chambers & Tzavella, 2020). With registered reports, authors submit the introduction, method, and planned analyses section for review, before collecting and/or analyzing any data.…”

Section: How Greater Synergy Between Open Science and Cultural Psychomentioning

confidence: 99%

Cultural Psychology, Diversity, and Representation in Open Science

Syed¹,

Kathawalla²

2020

Preprint

View full text Add to dashboard Cite

The current moment in psychology is one of great challenges and great opportunities. The open science movement--the move towards more transparent, credible, and reproducible science--has led to a redefinition of what constitutes “normal science.” However, the field of cultural psychology, broadly construed, has by and large not engaged with the open science movement, and likewise, the open science movement has by and large not engaged with cultural psychology. The purpose of the present chapter is to bring open science and cultural psychology closer together, highlighting how they can benefit one another. In doing so, we focus our discussion on three types of representations regarding diversity in psychological research and how they intersect with open science: representation of researchers, or the diversity of the scientists actually doing the research, representation of samples, or who is included as participants in our research studies, and representation of perspectives, or the substantive conceptual and theoretical views we bring to our work. For each of these three types of representation we outline the problem, and then discuss how embracing the principles and behaviors of open science can help.

show abstract

“…This would help them to increase study quality before they start, potentially saving resources and even animals [7]. Through the log, reviewers could monitor the work as it unfolds, a "rolling review," as proposed by Chambers and Tzavella [8]. Alternatively, the log could be kept as an open laboratory notebook [9].…”

Section: Why Bother Preregistering Exploratory Research?mentioning

confidence: 99%

Preregistration of exploratory research: Learning from the golden age of discovery

Dirnagl

2020

PLoS Biol

View full text Add to dashboard Cite

Preregistration of study protocols and, in particular, Registered Reports are novel publishing formats that are currently gaining substantial traction. Besides rating the research question and soundness of methodology over outstanding significance of the results, they can help with antagonizing inadequate statistical power, selective reporting of results, undisclosed analytic flexibility, as well as publication bias. Preregistration works well when a clear hypothesis, primary outcome, and mode of analysis can be formulated. But is it also applicable and useful in discovery research, which develops theories and hypotheses, measurement techniques, and generates evidence that justifies further research? I will argue that only slight modifications are needed to harness the potential of preregistration and make exploratory research more trustworthy and useful.

show abstract

The past, present, and future of Registered Reports

Cited by 78 publications

References 46 publications

Why hypothesis testers should spend less time testing hypotheses

Why hypothesis testers should spend less time testing hypotheses

Cultural Psychology, Diversity, and Representation in Open Science

Preregistration of exploratory research: Learning from the golden age of discovery

Contact Info

Product

Resources

About