Sensitivity Analysis of Kernel Estimates: Implications in Nonlinear Physiological System Identification

Abstract

Many techniques have been developed for the estimation of the Volterra/Wiener kernels of nonlinear systems, and have found extensive application in the study of various physiological systems. To date, however, we are not aware of methods for estimating the reliability of these kernels from single data records. In this study, we develop a formal analysis of variance for least-squares based nonlinear system identification algorithms. Expressions are developed for the variance of the estimated kernel coefficients and are used to place confidence bounds around both kernel estimates and output predictions. Specific bounds are developed for two such identification algorithms: Korenberg's fast orthogonal algorithm and the Laguerre expansion technique. Simulations, employing a model representative of the peripheral auditory system, are used to validate the theoretical derivations, and to explore their sensitivity to assumptions regarding the system and data. The simulations show excellent agreement between the variances of kernel coefficients and output predictions as estimated from the results of a single trial compared to the same quantities computed from an ensemble of 1000 Monte Carlo runs. These techniques were validated with white and nonwhite Gaussian inputs and with white Gaussian and nonwhite non-Gaussian measurement noise on the output, provided that the output noise source was independent of the test input.

Analysis of functional MRI data based on an estimation of the hemodynamic response in the human brain

“…These advantages are all critical for a successful application (Petersson et al, 1999;Westwick et al, 1998).…”

Nonlinear Dynamic Model of CA1 Short-Term Plasticity using Random Impulse Train Stimulation

“…It reduces the kernel estimation variance but increases the kernel estimation bias. A detailed discussion on the variability of the kernels computed via the Laguerre expansion method can be found in Westwick et al 35 The accuracy of the estimated kernels is assessed by the Normalized Mean Square Error (NMSE), defined as follows:…”

Interpreting Microarray Data and Related Applications Using Nonlinear System Identification

“…Zhang et al [23] proposed a method of combining Akaike's final prediction error criterion [24,25] with the FOA [13,14] to determine the memory length simultaneously with the kernels. Westwick et al [26] developed bounds for the variance of kernel estimates, computable from single data records, for the FOA [13,14] and for kernel estimation via use of Laguerre functions [9 -12].…”