The evaluation uncertainty caused by standard reference itself is harmful to both algorithm developers and data users to substantially understand the error features and the performance of satellite precipitation products (SPPs). In this study, the Climate Precipitation Center unified (CPCU) data and the Merged Precipitation Analysis (MPA) data, are used as the benchmark to investigate the evaluation uncertainties of satellite precipitation estimates generated by reference itself. Two SPPs including IMERG-Late and GSMaP-MVK are employed here. The results show that the approach using two different ground-based precipitation products as the references can effectively reveal the potential evaluation uncertainties. Interestingly, it is found that the evaluation results are prone to resulting in larger uncertainties over semi-humid areas. Furthermore, evaluation uncertainty of statistical metrics is closely related to rainfall intensity and in that it has a gradually decreasing tendency with increasing rainfall intensities. Additionally, we also found that the dependency of False Alarm Ratio (FAR) and Root Mean Squared Error (RMSE) scores on the spatial density of rain gauges is relatively low. Both Relative Bias (RBIAS) and Normalized Root Mean Squared Error (NRMSE) scores for light precipitation (1-5 mm/day) increase with the spatial density of the rain gauge, suggesting that the evaluation of light precipitation can easily cause uncertainties relative to medium-high rain rates. Finally, the minimum gauge density adaptive for different scores and different rainfall intensities is discussed. This study is expected to provide a criteria to investigate the reliability of evaluation results for the satellite quantitative precipitation estimation community.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.