We present an adaptive dual model predictive controller (dmpc) that uses current and future parameter-estimate errors to minimize expected output error by optimally combining probing for uncertainty reduction with control of the nominal model. Our novel approach relies on orthonormal basis-function models to derive expressions for the predicted distributions for the output and unknown parameters, conditional on the future input sequence. Propagating the exact future statistics enables reformulating the original stochastic problem into a deterministic equivalent that illustrates the dual nature of the optimal control but is nonlinear and nonconvex. We further reformulate the nonlinear deterministic problem to pose an equivalent quadratically-constrained quadratic-programming (qcqp) problem that state-of-the-art algorithms can solve efficiently, providing the exact solution to the probabilistically constrained finite-horizon dual control problem. The adaptive dmpc solves this qcqp at each sampling time on a receding horizon; the adaptation is a result of updating the parameter estimates used by the dmpc to decide the control input. The paper demonstrates the application of dmpc to a single-input single-output (siso) system with unknown parameters. In the simulation example, the parameter estimates converge quickly and the probing vanishes with increasing accuracy and precision of the estimates, improving the future control performance.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.