A guide for social science journal editors on easing into open science

Silverstein, Priya; Elman, Colin; Montoya, Amanda; McGillivray, Barbara; Pennington, Charlotte R.; Harrison, Chase H.; Steltenpohl, Crystal N.; Röer, Jan Philipp; Corker, Katherine S.; Charron, Lisa M.; Elsherif, Mahmoud; Malicki, Mario; Hayes-Harb, Rachel; Grinschgl, Sandra; Neal, Tess; Evans, Thomas Rhys; Karhulahti, Veli-Matti; Krenzer, William L. D.; Belaus, Anabel; Moreau, David; Burin, Debora I.; Chin, Elizabeth; Plomp, Esther; Mayo-Wilson, Evan; Lyle, Jared; Adler, Jonathan M.; Bottesini, Julia G.; Lawson, Katherine M.; Schmidt, Kathleen; Reneau, Kyrani; Vilhuber, Lars; Waltman, Ludo; Gernsbacher, Morton Ann; Plonski, Paul E.; Ghai, Sakshi; Grant, Sean; Christian, Thu-Mai; Ngiam, William; Syed, Moin

doi:10.1186/s41073-023-00141-5

Cited by 7 publications

(1 citation statement)

References 102 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Concerns about replicability have therefore grown over the last decade, and have also been echoed in other sciences (e.g., Errington et al, 2021;Nosek & Errington, 2017). These concerns have led to substantially large collaborative efforts to enhance the quality of psychological research (e.g., Ebersole et al, 2020;Morey et al, 2016;Moshontz et al, 2018) and the wider academic system (e.g., Davis et al, 2018;Eder & Frings, 2021;Frith, 2020;Pennington, 2024;Silverstein et al, 2024;Stengers, 2020;Stewart et al, 2020). Moreover, individual researchers and smaller groups of researchers have started engaging in more replication research (e.g., Soderberg et al, 2021;Visser et al, 2022;Pavlov et al, 2021).…”

mentioning

confidence: 99%

The Replication Database: Documenting the Replicability of Psychological Science

Röseler,

Kaiser,

Doetsch

et al. 2024

Preprint

View full text Add to dashboard Cite

In psychological science, replicability—repeating a study with a new sampleachieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://metaanalyses.shinyapps.io/replicationdatabase/), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

show abstract

mentioning

confidence: 99%

The Replication Database: Documenting the Replicability of Psychological Science

Röseler,

Kaiser,

Doetsch

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

Tactics of just, equitable, diverse, and inclusive scientific research

Kyonka,

Subramaniam

2024

J Exper Analysis Behavior

View full text Add to dashboard Cite

The principles of social justice, equity, diversity, inclusion (JEDI) have received increasing attention in behavior analysis circles, but the conversation has largely centered on implications for applied behavior analysis practice and research. It may be less clear to researchers who conduct basic and translational research how JEDI principles can inform and inspire their work. This article synthesizes publications from behavior analysis and other scientific fields about tactics of JEDI‐informed research. We organized this scholarship across five stages of research from developing the research question to sharing findings and curated sources for an audience of behavioral science researchers. We discuss reflexive practice, representation, belongingness, participatory research, quantitative critical theory, and open science, among other topics. Some researchers may have already adopted some of the practices outlined, some may begin new practices, and some may choose to conduct experimental analyses of JEDI problems. Our hope is that those actions will be reinforced by the behavior analysis scientific community. We conclude by encouraging the leadership of this journal to continue to work toward the structural changes necessary to make the experimental analysis of behavior just, equitable, diverse, and inclusive.

show abstract

Open science practices in criminology and criminal justice journals

Greenspan,

Baggett,

B. Boutwell

2024

J Exp Criminol

View full text Add to dashboard Cite

Objective Calls for more transparent and replicable scientific practices have been increasing across scientific disciplines over the last decade, often referred to as the open science movement. Open science practices are arguably particularly important in fields like criminology and criminal justice where empirical findings aim to inform public policy and legal practice. Despite favorable views of these practices by criminal justice scholars, limited research has explored how often researchers actually use these open science practices. Method The current study measures the reported use of pre-registration, open access, open materials, open data, and open code in leading criminology and criminal justice journals from 2018 to 2022. Results Our results reveal limited use of open science practices, particularly pre-registration and open code. Conclusions Given these findings, we call for both journals and authors to consider adopting these practices to move toward a more transparent and replicable field.

show abstract

A guide for social science journal editors on easing into open science

Cited by 7 publications

References 102 publications

The Replication Database: Documenting the Replicability of Psychological Science

The Replication Database: Documenting the Replicability of Psychological Science

Tactics of just, equitable, diverse, and inclusive scientific research

Open science practices in criminology and criminal justice journals

Contact Info

Product

Resources

About