Author guidelines for journals could help to promote transparency, openness, and reproducibility

This article was originally submitted for publication to the Editor of Advances in Methods and Practices in Psychological Science (AMPPS) in 2015. When the submitted manuscript was subsequently posted online (Silberzahn et al., 2015), it received some media attention, and two of the authors were invited to write a brief commentary in Nature advocating for greater crowdsourcing of data analysis by scientists. This commentary, arguing that crowdsourced research "can balance discussions, validate findings and better inform policy" (Silberzahn & Uhlmann, 2015, p. 189), included a new figure that displayed the analytic teams' effectsize estimates and cited the submitted manuscript as the source of the findings, with a link to the preprint. However, the authors forgot to add a citation of the Nature commentary to the final published version of the AMPPS article or to note that the main findings had been previously publicized via the commentary, the online preprint, research presentations at conferences and universities, and media reports by other people. The authors regret the oversight.

IntroductionEnteric infections are common during the first years of life in low-income countries and contribute to growth faltering with long-term impairment of health and development. Water quality, sanitation, handwashing and nutritional interventions can independently reduce enteric infections and growth faltering. There is little evidence that directly compares the effects of these individual and combined interventions on diarrhoea and growth when delivered to infants and young children. The objective of the WASH Benefits study is to help fill this knowledge gap.Methods and analysisWASH Benefits includes two cluster-randomised trials to assess improvements in water quality, sanitation, handwashing and child nutrition—alone and in combination—to rural households with pregnant women in Kenya and Bangladesh. Geographically matched clusters (groups of household compounds in Bangladesh and villages in Kenya) will be randomised to one of six intervention arms or control. Intervention arms include water quality, sanitation, handwashing, nutrition, combined water+sanitation+handwashing (WSH) and WSH+nutrition. The studies will enrol newborn children (N=5760 in Bangladesh and N=8000 in Kenya) and measure outcomes at 12 and 24 months after intervention delivery. Primary outcomes include child length-for-age Z-scores and caregiver-reported diarrhoea. Secondary outcomes include stunting prevalence, markers of environmental enteropathy and child development scores (verbal, motor and personal/social). We will estimate unadjusted and adjusted intention-to-treat effects using semiparametric estimators and permutation tests.Ethics and disseminationStudy protocols have been reviewed and approved by human subjects review boards at the University of California, Berkeley, Stanford University, the International Centre for Diarrheal Disease Research, Bangladesh, the Kenya Medical Research Institute, and Innovations for Poverty Action. Independent data safety monitoring boards in each country oversee the trials. This study is funded by a grant from the Bill & Melinda Gates Foundation to the University of California, Berkeley.RegistrationTrial registration identifiers (http://www.clinicaltrials.gov): NCT01590095 (Bangladesh), NCT01704105 (Kenya).

Abstract:There is growing interest in enhancing research transparency and reproducibility in economics and other scientific fields. We survey existing work on these topics within economics, and discuss the evidence suggesting that publication bias, inability to replicate, and specification searching remain widespread in the discipline. We next discuss recent progress in this area, including through improved research design, study registration and pre-analysis plans, disclosure standards, and open sharing of data and materials, drawing on experiences in both economics and other social sciences. We discuss areas where consensus is emerging on new practices, as well as approaches that remain controversial, and speculate about the most effective ways to make economics research more credible in the future. 1 We thank the editor Steven Durlauf and four anonymous referees for useful comments.