Robust Temporal Logic Inference for Hybrid System Observation– An Application on Occupancy Detection of Smart Buildings

Xu, Zhe; Deng, Yi; Julius, A. Agung

doi:10.23919/acc.2018.8431834

Cited by 2 publications

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Switched Linear Systems Meet Markov Decision Processes: Stability Guaranteed Policy Synthesis

Cubuktepe

Topcu

2019

2019 IEEE 58th Conference on Decision and Control (CDC)

View full text Add to dashboard Cite

Switched linear systems are time-varying nonlinear systems whose dynamics switch between different modes, where each mode corresponds to different linear dynamics. They arise naturally to model unexpected failures, environment uncertainties or system noises during system operation. In this paper, we consider a special class of switched linear systems where the mode switches are governed by Markov decision processes (MDPs). We study the problem of synthesizing a policy in an MDP that stabilizes the switched system. Given a policy, the switched linear system becomes a Markov jump linear system whose stability conditions have been extensively studied. We make use of these stability conditions and propose three different computation approaches to find the stabilizing policy in an MDP. We derive our first approach by extending the stability conditions for a Markov jump linear system to handle switches governed by an MDP. This approach requires finding a feasible solution of a set of bilinear matrix inequalities, which makes policy synthesis typically challenging. To improve scalability, we provide two approaches based on convex optimization. We give three examples to show and compare our proposed solutions.

show abstract