An intercomparison of the Environment Canada variational and ensemble Kalman filter (EnKF) data assimilation systems is presented in the context of global deterministic NWP. In an EnKF experiment having the same spatial resolution as the inner loop in the four-dimensional variational data assimilation system (4D-Var), the mean of each analysis ensemble is used to initialize the higher-resolution deterministic forecasts. Five different variational data assimilation experiments are also conducted. These include both 4D-Var and 3D-Var (with first guess at appropriate time) experiments using either (i) prescribed background-error covariances similar to those used operationally, which are static in time and include horizontally homogeneous and isotropic correlations; or (ii) flow-dependent covariances computed from the EnKF background ensembles with spatial covariance localization applied. The fifth variational data assimilation experiment is a new approach called the Ensemble-4D-Var (En-4D-Var). This approach uses 4D flow-dependent background-error covariances estimated from EnKF ensembles to produce a 4D analysis without the need for tangent-linear or adjoint versions of the forecast model. In this first part of a two-part paper, results from a series of idealized assimilation experiments are presented. In these experiments, only a single observation or vertical profile of observations is assimilated to explore the impact of various fundamental differences among the EnKF and the various variational data assimilation approaches considered. In particular, differences in the application of covariance localization in the EnKF and variational approaches are shown to have a significant impact on the assimilation of satellite radiance observations. The results also demonstrate that 4D-Var and the EnKF can both produce similar 4D background-error covariances within a 6-h assimilation window. In the second part, results from medium-range deterministic forecasts for the study period of February 2007 are presented for the EnKF and the five variational data assimilation approaches considered.

An intercomparison of the Environment Canada variational and ensemble Kalman filter (EnKF) data assimilation systems is presented in the context of producing global deterministic numerical weather forecasts. Five different variational data assimilation approaches are considered including four-dimensional variational data assimilation (4D-Var) and three-dimensional variational data assimilation (3D-Var) with first guess at the appropriate time (3D-FGAT). Also included among these is a new approach, called Ensemble-4D-Var (En-4D-Var), that uses 4D ensemble background-error covariances from the EnKF. A description of the experimental configurations and results from single-observation experiments are presented in the first part of this two-part paper. The present paper focuses on results from medium-range deterministic forecasts initialized with analyses from the EnKF and the five variational data assimilation approaches for the period of February 2007. All experiments assimilate exactly the same full set of meteorological observations and use the same configuration of the forecast model to produce global deterministic medium-range forecasts. The quality of forecasts in the short (medium) range obtained by using the EnKF ensemble mean analysis is slightly degraded (improved) in the extratropics relative to using the 4D-Var analysis with background-error covariances similar to those used operationally. The use of the EnKF flow-dependent error covariances in the variational system (4D-Var or 3D-FGAT) leads to large (modest) forecast improvements in the southern extratropics (tropics) as compared with using covariances similar to the operational system (a gain of up to 9 h at day 5). The En-4D-Var approach leads to (i) either improved or similar forecast quality when compared with the 4D-Var experiment similar to the currently operational system, (ii) slightly worse forecast quality when compared with the 4D-Var experiment with EnKF error covariances, and (iii) generally similar forecast quality when compared with the EnKF experiment.

A major set of changes was made to the Environment Canada global deterministic prediction system during the fall of 2014, including the replacement of four-dimensional variational data assimilation (4DVar) by four-dimensional ensemble–variational data assimilation (4DEnVar). The new system provides improved forecast accuracy relative to the previous system, based on results from two sets of two-month data assimilation and forecast experiments. The improvements are largest at shorter lead times, but significant improvements are maintained in the 120-h forecasts for most regions and vertical levels. The improvements result from the combined impact of numerous changes, in addition to the use of 4DEnVar. These include an improved treatment of radiosonde and aircraft observations, an improved radiance bias correction procedure, the assimilation of ground-based GPS data, a doubling of the number of assimilated channels from hyperspectral infrared sounders, and an improved approach for initializing model forecasts. Because of the replacement of 4DVar with 4DEnVar, the new system is also more computationally efficient and easier to parallelize, facilitating a doubling of the analysis increment horizontal resolution. Replacement of a full-field digital filter with the 4D incremental analysis update approach, and the recycling of several key variables that are not directly analyzed significantly reduced the model spinup during both the data assimilation cycle and in medium-range forecasts.

In this paper, the operational 3D variational data assimilation system (3D-var)

Abstract. The goal of this study is to evaluate a version of the ensemble-variational data assimilation approach (EnVar) for possible replacement of 4D-Var at Environment Canada for global deterministic weather prediction. This implementation of EnVar relies on 4-D ensemble covariances, obtained from an ensemble Kalman filter, that are combined in a vertically dependent weighted average with simple static covariances. Verification results are presented from a set of data assimilation experiments over two separate 6-week periods that used assimilated observations and model configuration very similar to the currently operational system. To help interpret the comparison of EnVar versus 4D-Var, additional experiments using 3D-Var and a version of EnVar with only 3-D ensemble covariances are also evaluated. To improve the rate of convergence for all approaches evaluated (including EnVar), an estimate of the cost function Hessian generated by the quasi-Newton minimization algorithm is cycled from one analysis to the next.Analyses from EnVar (with 4-D ensemble covariances) nearly always produce improved, and never degraded, forecasts when compared with 3D-Var. Comparisons with 4D-Var show that forecasts from EnVar analyses have either similar or better scores in the troposphere of the tropics and the winter extra-tropical region. However, in the summer extratropical region the medium-range forecasts from EnVar have either similar or worse scores than 4D-Var in the troposphere. In contrast, the 6 h forecasts from EnVar are significantly better than 4D-Var relative to radiosonde observations for both periods and in all regions. The use of 4-D versus 3-D ensemble covariances only results in small improvements in forecast quality. By contrast, the improvements from using 4D-Var versus 3D-Var are much larger. Measurement of the fit of the background and analyzed states to the observations suggests that EnVar and 4D-Var can both make better use of observations distributed over time than 3D-Var. In summary, the results from this study suggest that the EnVar approach is a viable alternative to 4D-Var, especially when the simplicity and computational efficiency of EnVar are considered. Additional research is required to understand the seasonal dependence of the difference in forecast quality between EnVar and 4D-Var in the extra-tropics.