There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of articles (1.6% of tested articles) using their available artifacts. We estimated, with 95% confidence, that results might be reproduced for only 0.6% to 6.8% of all 1,989 articles. Unlike prior studies, the survey tool identified key bottlenecks to making work more reproducible. Bottlenecks include: only some digital artifacts available (44% of articles), no directions (89%), or all artifacts available but results not reproducible (5%). The tool (or extensions) can help authors, journals, funders, and institutions to self-assess manuscripts, provide feedback to improve reproducibility, and recognize and reward reproducible articles as examples for others.

BioOne Complete (complete.BioOne.org) is a full-text database of 200 subscribed and open-access titles in the biological, ecological, and environmental sciences published by nonprofit societies, associations, museums, institutions, and presses.

In the original version of this Article the author of reference #38 was incorrectly stated as Quinn, J. et al. This has been corrected to Xu, W. et al. in both the HTML and PDF versions.

In the Upper Colorado River Basin, agriculture is a major contributor to Utah’s economy, which may be stressed due to the changing climate. In this study, two data-mining techniques and interview data are used to explore how climate variability affects agricultural production and the way the farmers have been adapting their practices to these changes. In the first part of the study, we used multilinear regression and random forest regression to understand the relationship between climate and agricultural production using temperature, precipitation, water availability, hay production, and cattle herd size. The quantitative results showed weak relations among variables. In the second part of the study, we interviewed ranchers to fill the gaps in the quantitative analysis. Over the 35 years (1981–2015), the quantitative analysis shows that temperature has affected cattle and hay production more than precipitation. Among non-climatic variables, resource availability and commodity prices are the most important factors that influence year-to-year production. Farmers are well-aware of these effects and have adapted accordingly. They have changed irrigation practices, cropping patterns, and are experimenting to produce a hybrid species of cattle, that are resilient to a hotter temperature and can use a wider variety of forage.

No abstract