No abstract

The preconditioning step in linear solvers of weather and climate models can be performed using machine learning.• The approach can be learned from timesteps and no analytically-derived preconditioner is required as reference.• The machine-learned preconditioner can be interpreted in order to improve designs of conventional preconditioners.

Semi‐implicit (SI) time‐stepping schemes for atmosphere and ocean models require elliptic solvers that work efficiently on modern supercomputers. This paper reports our study of the potential computational savings when using mixed precision arithmetic in the elliptic solvers. Precision levels as low as half (16 bits) are used and a detailed evaluation of the impact of reduced precision on the solver convergence and the solution quality is performed. This study is conducted in the context of a novel SI shallow‐water model on the sphere, purposely designed to mimic numerical intricacies of modern all‐scale weather and climate (W&C) models. The governing algorithm of the shallow‐water model is based on the non‐oscillatory MPDATA methods for geophysical flows, whereas the resulting elliptic problem employs a strongly preconditioned non‐symmetric Krylov‐subspace Generalized Conjugated‐Residual (GCR) solver, proven in advanced atmospheric applications. The classical longitude/latitude grid is deliberately chosen to retain the stiffness of global W&C models. The analysis of the precision reduction is done on a software level, using an emulator, whereas the performance is measured on actual reduced precision hardware. The reduced‐precision experiments are conducted for established dynamical‐core test‐cases, like the Rossby‐Haurwitz wavenumber 4 and a zonal orographic flow. The study shows that selected key components of the elliptic solver, most prominently the preconditioning and the application of the linear operator, can be performed at the level of half precision. For these components, the use of half precision is found to yield a speed‐up of a factor 4 compared to double precision for a wide range of problem sizes.

<p>Semi-implicit grid-point models for the atmosphere and the ocean require linear solvers that are working efficiently on modern supercomputers. The huge advantage of the semi-implicit time-stepping approach is that it enables large model time-steps. This however comes at the cost of having to solve a computationally demanding linear problem each model time-step to obtain an update to the model’s pressure/fluid-thickness field. In this study, we investigate whether machine learning approaches can be used to increase the efficiency of the linear solver.</p><p>Our machine learning approach aims at replacing a key component of the linear solver—the preconditioner. In the preconditioner an approximate matrix inversion is performed whose quality largely defines the linear solver’s performance. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for, as the linear solver ensures that a sufficient, pre-set level of accuracy is reached. The approach does not require prior availability of a conventional preconditioner and is highly flexible regarding complexity and machine learning design choices.</p><p>Several machine learning methods of different complexity from simple linear regression to deep feed-forward neural networks are used to learn the optimal preconditioner for a shallow-water model with semi-implicit time-stepping. The shallow-water model is specifically designed to be conceptually similar to more complex atmosphere models. The machine-learning preconditioner is competitive with a conventional preconditioner and provides good results even if it is used outside of the dynamical range of the training dataset.</p>