An algorithm is proposed for simultaneous estimation of model parameters, process disturbance intensities, and measurement noise variances for nonlinear dynamic systems that are described by stochastic differential equations. The proposed fully-Laplace approximation expectation maximization (FLAEM) algorithm uses an iterative approach wherein, in the first step, the model parameters are estimated using the approximate maximum likelihood estimation objective function developed by Varziri et al., 1 assuming that disturbance intensities and noise variances are known. In the second step, process disturbance intensities and measurement noise variance estimates are updated using expressions that rely on the fully-Laplace approximation in the expectation maximization algorithm. The proposed FLAEM method is illustrated using a nonlinear two-state continuous stirred tank reactor (CSTR) example. The effectiveness of the FLAEM algorithm is compared with a maximum-likelihood based method proposed by Kristensen et al. 2 For the CSTR example studied, FLAEM provides more accurate parameter estimates and is more robust to poorly known initial guesses of parameters and to smaller data sets.
INTRODUCTIONMany chemical processes are modeled using ordinary differential equations (ODEs) or algebraic equations (AEs) arising from fundamental laws of physics and chemistry. 3â5 However, some chemical engineering processes are better modeled using stochastic differential equations (SDEs) that account for possible modeling imperfections and stochastic process disturbances. 3,6 Stochastic terms that are included in SDE models can result in improved model predictions due to decreased bias in parameter estimates. 3,7 Parameter estimates obtained using SDE models are suitable for online process monitoring applications because SDE models account for measurement errors and stochastic process disturbance, the two types of random errors that are accounted for by extended Kalman filters (EKFs) and related state estimators. 8,9 In this article, we consider a multi-input multi-output (MIMO) nonlinear SDE model of the following form: