Estimating Distributions of Parameters in Nonlinear State Space Models with Replica Exchange Particle Marginal Metropolis–Hastings Method

Abstract

Extracting latent nonlinear dynamics from observed time-series data is important for understanding a dynamic system against the background of the observed data. A state space model is a probabilistic graphical model for time-series data, which describes the probabilistic dependence between latent variables at subsequent times and between latent variables and observations. Since, in many situations, the values of the parameters in the state space model are unknown, estimating the parameters from observations is an important task. The particle marginal Metropolis–Hastings (PMMH) method is a method for estimating the marginal posterior distribution of parameters obtained by marginalization over the distribution of latent variables in the state space model. Although, in principle, we can estimate the marginal posterior distribution of parameters by iterating this method infinitely, the estimated result depends on the initial values for a finite number of times in practice. In this paper, we propose a replica exchange particle marginal Metropolis–Hastings (REPMMH) method as a method to improve this problem by combining the PMMH method with the replica exchange method. By using the proposed method, we simultaneously realize a global search at a high temperature and a local fine search at a low temperature. We evaluate the proposed method using simulated data obtained from the Izhikevich neuron model and Lévy-driven stochastic volatility model, and we show that the proposed REPMMH method improves the problem of the initial value dependence in the PMMH method, and realizes efficient sampling of parameters in the state space models compared with existing methods.

Research on Parameter Estimation and Prediction of Sports Financial Market Volatility Model

“…Since the 19th CPC National Congress, China's extensive and high growth stage of economic development has basically ended. Instead, it entered a period of high-quality development aimed at maintaining sustained and healthy economic development [8]. To solve the problems of unbalanced, uncoordinated, and insufficient economic development, we must vigorously promote supply-side structural reforms and promote the optimization and upgrading of the industrial structure [9].…”

Sparse Estimation for Hamiltonian Mechanics

“…Typical data-driven approaches include methods using Bayesian estimation [13][14][15][16][17][18] and deep learning [19][20][21][22][23][24]. Bayesian estimation is used to estimate the parameters of a model but requires a certain modeling and cannot deal with completely unknown mechanisms.…”