Combining data assimilation and machine learning to infer unresolved scale parametrization

Abstract

In recent years, machine learning (ML) has been proposed to devise data-driven parametrizations of unresolved processes in dynamical numerical models. In most cases, the ML training leverages high-resolution simulations to provide a dense, noiseless target state. Our goal is to go beyond the use of high-resolution simulations and train ML-based parametrization using direct data, in the realistic scenario of noisy and sparse observations. The algorithm proposed in this work is a two-step process. First, data assimilation (DA) techniques are applied to estimate the full state of the system from a truncated model. The unresolved part of the truncated model is viewed as a model error in the DA system. In a second step, ML is used to emulate the unresolved part, a predictor of model error given the state of the system. Finally, the ML-based parametrization model is added to the physical core truncated model to produce a hybrid model. The DA component of the proposed method relies on an ensemble Kalman filter while the ML parametrization is represented by a neural network. The approach is applied to the two-scale Lorenz model and to MAOOAM, a reduced-order coupled ocean-atmosphere model. We show that in both cases, the hybrid model yields forecasts with better skill than the truncated model. Moreover, the attractor of the system is significantly better represented by the hybrid model than by the truncated model. This article is part of the theme issue ‘Machine learning for weather and climate modelling’.

Using machine learning to correct model error in data assimilation and forecast applications

“…A natural idea to overcome these issues is, instead of constructing the surrogate model from scratch, to build a hybrid model using an already existing, knowledge‐based model (Pathak et al ., 2018b; Brajard et al ., 2020b). In fact, this would mean that we would try to correct the error of the knowledge‐based model.…”

Deep learning techniques applied to super-resolution chemistry transport modeling for operational uses

“…Regarding the poor concordance between rural observations and the HR ground truth, it suggests the importance of using data assimilation in high-resolution CTMs. On this particular issue, our SRNN models may be used as fast surrogate simulations in a model-based ensemble data assimilation framework [37][38][39]. They can also be extended to a fully NN-based data assimilation scheme, where the end-to-end learning strategy consists in using both the coarse resolution (with the HR covariates) and the observations to feed a neural network whose target is the anomaly between the observations and the coarse resolution [32,40].…”

Deep Emulators for Differentiation, Forecasting, and Parametrization in Earth Science Simulators

“…Our results build on a growing literature describing networks that learn system dynamics (Grzeszczuk et al., 1998; Sanchez‐Gonzalez et al., 2020), arising from ordinary differential equations (Chen et al., 2019; Fablet et al., 2018) and PDEs (Long et al., 2018; Rudy et al., 2019), some of which have applied numerical integration schemes during training (Wang & Lin, 1998). Several studies have used ML to learn parametrizations for L96 (Dueben & Bauer, 2018; Gagne et al., 2020; Watson, 2019) and other Earth science models but have either used offline training or employed Ensemble Kalman filtering and related approaches that do not require derivatives (Brajard et al., 2021; Pawar & San, 2020; Rasp, 2020).…”