The dual-control problem for time-varying or non-linear stochastic systems is inherently analytically and computationally untractable due to the demand of alternating minimizations and mean value computations. Hence, it has to be approached using approximations leading to suboptimal dual control. The core of the successful approximative controller is its ability to be able to consider future changes in the development of the parameters.This paper presents an analysis of the dual-control concept, and a comparison between a number of suboptimal controllers. The analytical comparisons are based on a reformulation of the dual-control problem. This reformulation makes it possible to interpret and understand the nature of di!erent approximations to dual control, in particular the Adaptive Predictive Controller (APC) and the Active Suboptimal Dual Controller (ASOD). Furthermore it makes the origin of the computational problems encountered more clear, and suggests new alternatives for approximation. The analysis is carried through on relatively simple examples and is illustrated with simulations. The performance of the controllers when applied to more complicated time-varying systems is illustrated with simulations as well.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.