This paper develops methodologies for the averaging, aggregation and optimal control of stochastic hybrid systems whose state equations depend on continuoustime, nearly completely decomposable ® nite state Markov chains. Such Markovian switching models are assumed to have several identi® ed groups of strongly interacting states. The random sample solution process of the system state can be well approximated by a deterministic trajectory, for the duration of an interval of which the switching process sojourns in a group. Aggregated models are obtained by utilizing the aggregation method over the in® nite time interval. By using the perturbation approach, necessary and su cient conditions of stochastic stabilizability and controllability proposed by Ji and Chizeck (1990) are presented for the systems. With the aggregation models and the known results of stochastic stabilizability, near-optimum ® nite time and in® nite time Markovian jump linear quadratic control laws are also investigated. The limiting behaviour of corresponding minimized averaged cost functions is studied. Finally, an illustrative example is performed to illustrate the feasibility and e ectiveness of the proposed techniques.

No abstract

No abstract

No abstract

No abstract