[1] We show that Mean Squared Error (MSE) and Nash-Sutcliffe Efficiency (NSE) type metrics typically vary on bounded ranges under optimization and that negative values of NSE imply severe mass balance errors in the data. Further, by constraining simulated mean and variability to match those of the observations (diagnostic approach), the sensitivity of both metrics is improved, and NSE becomes linearly related to the cross-correlation coefficient. Our results have important implications for analysis of the information content of data and hence about inferences regarding achievable parameter precision.Citation: Gupta, H. V., and H. Kling (2011), On typical range, sensitivity, and normalization of Mean Squared Error and NashSutcliffe Efficiency type metrics, Water Resour. Res., 47, W10601,
This study is a contribution to a model intercomparison experiment initiated during a workshop at the 2013 IAHS conference in Göteborg, Sweden. We present discharge simulations with the conceptual precipitation-runoff model COSERO in 11 basins located under different climates in Europe, Africa and Australia. All of the basins exhibit some form of non-stationary conditions, due, for example, to warming, droughts or land-cover change. The evaluation of the daily discharge simulations focuses on the overall model performance and its decomposition into three components measuring temporal dynamics, mean flow volume and distribution of flows. Calibration performance is similarly high as in previous COSERO applications. However, when looking at evaluation periods independent of the calibration, the model performance drops considerably, mainly due to severely biased discharge simulations in semi-arid basins with strong non-stationarity in rainfall. Simulations are more robust in European basins with humid climates. This highlights the fact that hydrological models frequently fail when simulations are required outside of calibration conditions in basins with non-stationary conditions. As a consequence, calibration periods should be sufficiently long to include both wet and dry periods, which should yield more robust predictions.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.