Quantifying dynamical predictability: the pseudo-ensemble approach

Abstract

The ensemble technique has been widely used in numerical weather prediction and extended-range forecasting. Current approaches to evaluate the predictability using the ensemble technique can be divided into two major groups. One is dynamical, including generating Lyapunov vectors, bred vectors, and singular vectors, sampling the fastest error-growing directions of the phase space, and examining the dependence of prediction efficiency on ensemble size. The other is statistical, including distributional analysis and quantifying prediction utility by the Shannon entropy and the relative entropy. Currently, with simple models, one could choose as many ensembles as possible, with each ensemble containing a large number of members. When the forecast models become increasingly complicated, however, one would only be able to afford a small number of ensembles, each with limited number of members, thus sacrificing estimation accuracy of the forecast errors.To uncover connections between different information theoretic approaches and between dynamical and statistical approaches, we propose an ( , τ )-entropy and scale-dependent Lyapunov exponent -based general theoretical framework to quantify information loss in ensemble forecasting. More importantly, to tremendously expedite computations, reduce data storage, and improve forecasting accuracy, we propose a technique for constructing a large number of "pseudo" ensembles from one single solution or scalar dataset. This pseudo-ensemble technique appears to be applicable under rather general conditions, one important situation being that observational data are available but the exact dynamical model is unknown.

On the dynamics of ocean ambient noise: Two decades later

“…13 Since then, SDLE is used in various fields of research for characterizing the dynamic complexity of the time series signals. [47][48][49][50][51][52][53] SDLE can efficiently characterize the embedded dynamics in complex time series by identifying chaos, noisy chaos, stochastic oscillations, random 1/f process, random levy process, and complex time series with multiple scaling behaviors. Moreover, it is robust to nonstationarity.…”

Multiscale Analysis of Heart Rate Variability: A Comparison of Different Complexity Measures

“…Recently, using an ensemble forecasting approach, we have proven that c = D/D( 0 ), where D and D( 0 ) are the information dimension on infinitesimal and an initial finite scale in ensemble forecasting. 9 When a noisy dataset is finite, due to lack of data, D would soon saturate when m exceeds certain value. However, if the finite scale is quite large, D( 0 )~m, for a wide range of m. Therefore, c~1/m when m exceeds certain value.…”

Analyses of geographical observations in the Heihe River Basin: Perspectives from complexity theory

“…Hoping to characterize a complex time series on a broad range of scales simultaneously, recently, a new multiscale complexity measure, the scale-dependent Lyapunov exponent (SDLE), has been developed. SDLE was first introduced in (Gao et al, 2006c;Gao et al, 2007), and has been further developed in (Gao et al, 2009;Gao et al, 2012b) and applied to characterize EEG (Gao et al, 2011c), HRV (Hu et al, 2009a;Hu et al, 2010), financial time series (Gao et al, 2011a), and Earth's geodynamo (Ryan et al, 2008).…”