An efficient conjugate gradient based Cholesky CMA‐ES estimation algorithm for nonlinear systems

Abstract

This article studies the parameter estimation problems of nonlinear systems with colored noise using the covariance matrix adaptation evolution strategy (CMA‐ES), which is one of the most competitive evolutionary algorithms available and has been applied in the area of reinforcement learning and process control. However, a major limitation that impedes the application of the CMA‐ES is the high computational complexity caused by matrix decomposition. To solve this problem, an efficient Cholesky CMA‐ES which uses the Cholesky factor instead of the covariance matrix to reduce the computational complexity, and updates the search direction and distribution mean based on the conjugate gradient method to improve the search accuracy is proposed. By using the auxiliary model identification idea, the Cholesky CMA‐ES can be applied to solve the parameter estimation problems of the Hammerstein nonlinear systems with colored noise. Two simulation examples are provided to demonstrate its effectiveness.