Ensembles provide an opportunity to greatly improve short-term prediction of local weather hazards, yet generating reliable predictions remain a significant challenge. In particular, convection-permitting ensemble forecast systems (CPEFSs) have persistent problems with underdispersion. Representing initial and or lateral boundary condition uncertainty along with forecast model error provides a foundation for building a more dependable CPEFS, but the best practice for ensemble system design is not well established. Several configurations of CPEFSs are examined where ensemble forecasts are nested within a larger domain, drawing initial conditions from a downscaled, continuously cycled, ensemble data assimilation system that provides state-dependent initial condition uncertainty. The control ensemble forecast, with initial condition uncertainty only, is skillful but underdispersive. To improve the reliability of the ensemble forecasts, the control ensemble is supplemented with 1) perturbed lateral boundary conditions; or, model error representation using either 2) stochastic kinetic energy backscatter or 3) stochastically perturbed parameterization tendencies. Forecasts are evaluated against stage IV accumulated precipitation analyses and radiosonde observations. Perturbed ensemble forecasts are also compared to the control forecast to assess the relative impact from adding forecast perturbations. For precipitation forecasts, all perturbation approaches improve ensemble reliability relative to the control CPEFS. Deterministic ensemble member forecast skill, verified against radiosonde observations, decreases when forecast perturbations are added, while ensemble mean forecasts remain similarly skillful to the control.

Four model-error schemes for probabilistic forecasts over the contiguous United States with the WRF-ARW mesoscale ensemble system are evaluated in regard to performance. Including a model-error representation leads to significant increases in forecast skill near the surface as measured by the Brier score. Combining multiple model-error schemes results in the best-performing ensemble systems, indicating that current model error is still too complex to be represented by a single scheme alone. To understand the reasons for the improved performance, it is examined whether model-error representations increase skill merely by increasing the reliability and reducing the bias—which could also be achieved by postprocessing—or if they have additional benefits. Removing the bias results overall in the largest skill improvement. Forecasts with model-error schemes continue to have better skill than without, indicating that their benefit goes beyond bias reduction. Decomposing the Brier score into its components reveals that, in addition to the spread-sensitive reliability, the resolution component is significantly improved. This indicates that the benefits of including a model-error representation go beyond increasing reliability. This is further substantiated when all forecasts are calibrated to have similar spread. The calibrated ensembles with model-error schemes consistently outperform the calibrated control ensemble. Including a model-error representation remains beneficial even if the ensemble systems are calibrated and/or debiased. This suggests that the merits of model-error representations go beyond increasing spread and removing the mean error and can account for certain aspects of structural model uncertainty.

This expository paper documents an experimental, real-time, 10-member, 3-km, convection-allowing ensemble prediction system (EPS) developed at the National Center for Atmospheric Research (NCAR) in spring 2015. The EPS is particularly unique in that continuously cycling, limited-area, mesoscale ensemble Kalman filter analyses provide diverse initial conditions. In addition to describing the EPS configurations, initial forecast assessments are presented that suggest the EPS can provide valuable severe weather guidance and skillful predictions of precipitation. The EPS output is available to operational forecasters, many of whom have incorporated the products into their toolboxes. Given such rapid embrace of an experimental system by the operational community, acceleration of convection-allowing EPS development is encouraged.

Precipitation forecasts from convection-allowing ensembles with 3- and 1-km horizontal grid spacing were evaluated between 15 May and 15 June 2013 over central and eastern portions of the United States. Probabilistic forecasts produced from 10- and 30-member, 3-km ensembles were consistently better than forecasts from individual 1-km ensemble members. However, 10-member, 1-km probabilistic forecasts usually were best, especially over the first 12 h and at rainfall rates ≥ 5.0 mm h−1 at later times. Further object-based investigation revealed that better 1-km forecasts at heavier rainfall rates were associated with more accurate placement of mesoscale convective systems compared to 3-km forecasts. The collective results indicate promise for 1-km ensembles once computational resources can support their operational implementation.

38