Multi-Task Collaboration Deep Learning Framework for Infrared Precipitation Estimation

Abstract

Infrared observation is an all-weather, real-time, large-scale precipitation observation method with high spatio-temporal resolution. A high-precision deep learning algorithm of infrared precipitation estimation can provide powerful data support for precipitation nowcasting and other hydrological studies with high timeliness requirements. The “classification-estimation” two-stage framework is widely used for balancing the data distribution in precipitation estimation algorithms, but still has the error accumulation issue due to its simple series-wound combination mode. In this paper, we propose a multi-task collaboration framework (MTCF), i.e., a novel combination mode of the classification and estimation model, which alleviates the error accumulation and retains the ability to improve the data balance. Specifically, we design a novel positive information feedback loop composed of a consistency constraint mechanism, which largely improves the information abundance and the prediction accuracy of the classification branch, and a cross-branch interaction module (CBIM), which realizes the soft feature transformation between branches via the soft spatial attention mechanism. In addition, we also model and analyze the importance of the input infrared bands, which lay a foundation for further optimizing the input and improving the generalization of the model on other infrared data. Extensive experiments based on Himawari-8 demonstrate that compared with the baseline model, our MTCF obtains a significant improvement by 3.2%, 3.71%, 5.13%, 4.04% in F1-score when the precipitation intensity is 0.5, 2, 5, 10 mm/h, respectively. Moreover, it also has a satisfactory performance in identifying precipitation spatial distribution details and small-scale precipitation, and strong stability to the extreme-precipitation of typhoons.

A Deep Learning-Based Algorithm for Identifying Precipitation Clouds Using Fengyun-4A Satellite Observation Data

“…The Global Precipitation Measurement (GPM) mission is co-sponsored by the National Aeronautics and Space Administration (NASA) and Japan Aerospace Exploration Agency (JAXA) in partnership and provides global precipitation products [ 40 ]. The GPM satellites are mainly equipped with two types of sensors, the GPM Microwave Imager (GMI) and the Dual-frequency Precipitation Radar (DPR).…”

Multi‐Task Learning for Simultaneous Retrievals of Passive Microwave Precipitation Estimates and Rain/No‐Rain Classification

“…Recent studies on precipitation estimates have employed a two‐stage framework, which is a sequential architecture of a rain/no‐rain binary classification followed by rain rate regression (Yang et al., 2021). The primary concept of this framework is that a satellite precipitation algorithm is required to simultaneously achieve reliable results in rain/no‐rain detection and rainfall amount estimation under the skewness of the probability density function in precipitation data (Tao et al., 2018).…”