There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of articles (1.6% of tested articles) using their available artifacts. We estimated, with 95% confidence, that results might be reproduced for only 0.6% to 6.8% of all 1,989 articles. Unlike prior studies, the survey tool identified key bottlenecks to making work more reproducible. Bottlenecks include: only some digital artifacts available (44% of articles), no directions (89%), or all artifacts available but results not reproducible (5%). The tool (or extensions) can help authors, journals, funders, and institutions to self-assess manuscripts, provide feedback to improve reproducibility, and recognize and reward reproducible articles as examples for others.
Understanding the tradeoff between the information of high-resolution water use data and the costs of smart meters to collect data with sub-minute resolution is crucial to inform smart meter networks. To explore this tradeoff, we first present STREaM, a STochastic Residential water End-use Model that generates synthetic water end-use time series with 10-second and progressively coarser sampling resolutions. Second, we apply a comparative framework to STREaM output and assess the impact of data sampling resolution on end-use disaggregation, leak detection, peak demand estimation, data storage, and availability. Our findings show that increased sampling resolution allows more accurate end-use disaggregation, prompt water leakage detection, and accurate and timely estimates of peak demand. Simultaneously, data storage requirements and limited product availability mean most * Corresponding author. Tel.:+39-02-2399-9040Email address: andrea.cominola@polimi.it (A. Cominola)Preprint submitted to Environmental Modelling & Software October 22, 2017 large-scale, commercial smart metering deployments sense data with hourly, daily, or coarser sampling frequencies. Overall, this work provides insights for further research and commercial deployment of smart water meters.
To inform future decision-making regarding water supplies and uses, we must coordinate efforts to substantially improve our capacity to collect, model, and disseminate water-use data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.