Practical tools and strategies for researchers to increase replicability

Nuijten, Michèle B.

doi:10.1111/dmcn.14054

Cited by 38 publications

(41 citation statements)

References 48 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Along with the R package PELVIS freely available online, we also provide as Supporting Information online the R code used in this study to improve the replicability of all the results–figures and tables–presented hereafter. To promote an open and reproducible research in biological anthropology (Martin, ), this study follows the guidelines given by Nuijten ().…”

Section: Methodsmentioning

confidence: 99%

A method of sexing the human os coxae based on logistic regressions and Bruzek's nonmetric traits

Santos

Guyomarc’h

Rmoutilová

et al. 2019

American J Phys Anthropol

View full text Add to dashboard Cite

Objectives: This study aims at proposing a visual method for sexing the human os coxae based on a statistical approach, using a scoring system of traits described byBruzek (2002). This method is evaluated on a meta-population sample, where the data were acquired by direct observation of dry bones as well as computed tomography (CT) scans. A comparison with the original Bruzek's (2002) method is performed. Materials and methods: Five hundred and ninety two ossa coxae of modern humans are included in the reference dataset. Two other samples, composed respectively of 518 ossa coxae and 99 CT-scan images, are both used for validation purposes. The individuals come from five European or North American population samples. Eleven trichotomic traits (expressing female, male, or intermediate forms) were observed on each os coxae. The new approach employs statistical processing based on logistic regressions. An R package freely available online, PELVIS, implements both methods.Results: Both methods provide highly reliable sex estimates. The new statistical method has a slightly better accuracy rate (99.2%) than the former method (98.2%) but has also a higher rate of indeterminate individuals (12.9% vs. 3% for complete bones). Conclusion:The efficiency of both methods is compared. Low error rates were preferred over high ability of reaching the classification threshold. The impact of lateralization and the asymmetry of observed traits are discussed. Finally, it is shown that this visual method of sex estimation is reliable and easy to use through the graphical user interface of the R package. K E Y W O R D Ship bone, identification, innominate, morphoscopy, sex estimation

show abstract

Section: Methodsmentioning

confidence: 99%

A method of sexing the human os coxae based on logistic regressions and Bruzek's nonmetric traits

Santos

Guyomarc’h

Rmoutilová

et al. 2019

American J Phys Anthropol

View full text Add to dashboard Cite

show abstract

“…Regardless of career stage, several practical tools and strategies can be implemented in order to increase reproducibility and replicability of our work. As reviewed by Nuijten (2019), in addition to adopting preregistration, conducting multi-lab collaborations, and sharing data and code, which we have discussed above, this also includes working to improve our statistical inferences. She argues that many of the current problems in psychological science might relate to the (mis-)use and reporting of statistics.…”

Section: Opportunities For Increased Reproducibility Of Dcn 32mentioning

confidence: 99%

Opportunities for increased reproducibility and replicability of developmental neuroimaging

Klapwijk¹,

Bos²,

Tamnes³

et al. 2019

Preprint

View full text Add to dashboard Cite

Recently, many workflows and tools that aim to increase the reproducibility and replicability of research findings have been suggested. In this review, we discuss the opportunities that these efforts offer for the field of developmental cognitive neuroscience. We focus on issues broadly related to statistical power and to flexibility and transparency in data analyses. Critical considerations relating to statistical power include challenges in recruitment and testing of young populations, how to increase the value of studies with small samples, and the opportunities and challenges related to working with large-scale datasets. Developmental studies also involve challenges such as choices about age groupings, modelling across the lifespan, the analyses of longitudinal changes, and neuroimaging data that can be processed and analyzed in a multitude of ways. Flexibility in data acquisition, analyses and description may thereby greatly impact results. We discuss methods for improving transparency in developmental cognitive neuroscience, and how preregistration of studies can improve methodological rigor in the field. While outlining challenges and issues that may arise before, during, and after data collection, solutions and resources are highlighted aiding to overcome some of these. Since the number of useful tools and techniques is ever-growing, we highlight the fact that many practices can be implemented stepwise.

show abstract

“…While we understand researchers' trepidation to adopt the practice, there are guides and primers on how to efficiently conduct a pre-registration (see, Simmons, Nelson, & Simonsohn, 2017;van't Veer & Giner-Sorolla, 2016; http://help.osf.io/m/registrations ). Taking the pragmatic approach and gradually adopting more Open Science practices to incrementally increase the level of transparency in your research is still better than not adopting any at all (Klein et al, 2018;Nuijten, 2019). Use of any Open Science practice should be commended on making steps in the right direction, not condemned for not going further.…”

Section: Practical Recommendationsmentioning

confidence: 99%

Researcher Degrees of Freedom in the Psychology of Religion

Charles

Bartlett

Messick

et al. 2019

The International Journal for the Psychology of Religion

View full text Add to dashboard Cite

There is a push in psychology toward more transparent practices, stemming partially as a response to the replication crisis. We argue that the psychology of religion should help lead the way toward these new, more transparent practices to ensure a robust and dynamic subfield. One of the major issues that proponents of Open Science practices hope to address is researcher degrees of freedom (RDF). We pre-registered and conducted a systematic review of the 2017 issues from three psychology of religion journals. We aimed to identify the extent to which the psychology of religion has embraced Open Science practices and the role of RDF within the subfield. We found that many of the methodologies that help to increase transparency, such as pre-registration, have yet to be adopted by those in the subfield. In light of these findings, we present recommendations for addressing the issue of transparency in the psychology of religion and outline how to move toward these new Open Science practices.

show abstract

Practical tools and strategies for researchers to increase replicability

Cited by 38 publications

References 48 publications

A method of sexing the human os coxae based on logistic regressions and Bruzek's nonmetric traits

A method of sexing the human os coxae based on logistic regressions and Bruzek's nonmetric traits

Opportunities for increased reproducibility and replicability of developmental neuroimaging

Researcher Degrees of Freedom in the Psychology of Religion

Contact Info

Product

Resources

About