A survey on how preregistration affects the research workflow: better science but more work

Sarafoglou, Alexandra; Kovács, Márton; Bakos, Bence E.; Wagenmakers, Eric‐Jan; Aczél, Balázs

doi:10.1098/rsos.211997

Cited by 47 publications

(66 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Despite the benefits of preregistration (e.g., Sarafoglou et al, 2022) and its widespread adoption throughout psychology and other disciplines (Nosek & Lindsay, 2018) , the practice has not become standard in research on speech, language, and hearing. 1 Indeed, a recent survey among researchers in communication sciences and disorders (El Amin et al, preprint) found that although the desire to learn about preregistration was high, knowledge and implementation of preregistration was low (see also Alexander & Green, preprint) .…”

Section: Preregistration: Practical Considerations For Speech Languag...mentioning

confidence: 99%

Preregistration: Practical Considerations for Speech, Language, and Hearing Research

Brown

Strand

2023

J Speech Lang Hear Res

View full text Add to dashboard Cite

Purpose: In the last decade, psychology and other sciences have implemented numerous reforms to improve the robustness of our research, many of which are based on increasing transparency throughout the research process. Among these reforms is the practice of preregistration, in which researchers create a time-stamped and uneditable document before data collection that describes the methods of the study, how the data will be analyzed, the sample size, and many other decisions. The current article highlights the benefits of preregistration with a focus on the specific issues that speech, language, and hearing researchers are likely to encounter, and additionally provides a tutorial for writing preregistrations. Conclusions: Although rates of preregistration have increased dramatically in recent years, the practice is still relatively uncommon in research on speech, language, and hearing. Low rates of adoption may be driven by a lack of understanding of the benefits of preregistration (either generally or for our discipline in particular) or uncertainty about how to proceed if it becomes necessary to deviate from the preregistered plan. Alternatively, researchers may see the benefits of preregistration but not know where to start, and gathering this information from a wide variety of sources is arduous and time consuming. This tutorial addresses each of these potential roadblocks to preregistration and equips readers with tools to facilitate writing preregistrations for research on speech, language, and hearing. Supplemental Material: https://doi.org/10.23641/asha.21644843

show abstract

Section: Preregistration: Practical Considerations For Speech Languag...mentioning

confidence: 99%

Preregistration: Practical Considerations for Speech, Language, and Hearing Research

Brown

Strand

2023

J Speech Lang Hear Res

View full text Add to dashboard Cite

show abstract

“…Of course, journal articles in philosophy often do not clearly separate methods from results sections and philosophical research does not always proceed by testing hypotheses with empirical studies. Nonetheless, preregistration may still benefit researchers by improving theoretical aspects of research projects (Sarafoglou et al, 2022). For example, one thing preregistration forces researchers to do is to define primary and any secondary research questions and to clearly articulate research hypotheses.…”

Section: Proposals For Reliable Philosophical Researchmentioning

confidence: 99%

The replication crisis and philosophy

Buckwalter

2022

PhiMiSci

View full text Add to dashboard Cite

The replication crisis is perceived by many as one of the most significant threats to the reliability of research. Though reporting of the crisis has emphasized social science, all signs indicate that it extends to many other fields. This paper investigates the possibility that the crisis and related challenges to conducting research also extend to philosophy. According to one possibility, philosophy inherits a crisis similar to the one in science because philosophers rely on unreplicated or unreplicable findings from science when conducting philosophical research. According to another possibility, the crisis likely extends to philosophy because philosophers engage in similar research practices and face similar structural issues when conducting research that have been implicated by the crisis in science. Proposals for improving philosophical research are offered in light of these possibilities.

show abstract

“…Preregistration can reduce bias, increase transparency, and may also improve research quality (Hardwicke & Wagenmakers, 2021;Sarafoglou, Kovacs, et al, 2022). However, there are no checks and balances to evaluate whether the study outlined in a preregistration is well designed or clearly described (except when using the Registered Reports format; see Chambers & Tzavella, 2022).…”

Section: Leverage Complementary Workflows That Provide a Similar Func...mentioning

confidence: 99%

Reflections on Preregistration: Core Criteria, Badges, Complementary Workflows

Thibault¹,

Pennington²,

Munafò³

2022

Preprint

View full text Add to dashboard Cite

Clinical trials are routinely preregistered. In psychology and the social sciences, however, only a small percentage of studies are preregistered, and they often contain ambiguities. As advocates strive for broader uptake and effective use of preregistration, they can benefit from drawing on the experience of preregistration in clinical trials and adapting those successes to the psychology and social sciences context. We recommend that individuals and organizations who promote preregistration: (1) Establish core preregistration criteria required to consider a preregistration complete; (2) Award preregistered badges only to articles that meet the badge criteria; and (3) Leverage complementary workflows that provide a similar function as preregistration.

show abstract

A survey on how preregistration affects the research workflow: better science but more work

Cited by 47 publications

References 45 publications

Preregistration: Practical Considerations for Speech, Language, and Hearing Research

Preregistration: Practical Considerations for Speech, Language, and Hearing Research

The replication crisis and philosophy

Reflections on Preregistration: Core Criteria, Badges, Complementary Workflows

Contact Info

Product

Resources

About