Online and Compositional Learning of Controllers with Application to Floor Heating

Abstract

Controller synthesis for stochastic hybrid switched systems, like e.g. a floor heating system in a house, is a complex computational task that cannot be solved by an exhaustive search though all the control options. The state-space to be explored is in general uncountable due to the presence of continuous variables (e.g. temperature readings in the different rooms) and even after digitization, the state-space remains huge and cannot be fully explored. We suggest a general and scalable methodology for controller synthesis for such systems. Instead of off-line synthesis of a controller for all possible input temperatures and an arbitrary time horizon, we propose an on-line synthesis methodology, where we periodically compute the controller only for the near future based on the current sensor readings. This computation is itself done by employing machine learning in order to avoid enumeration of the whole state-space. For additional scalability we propose and apply a compositional synthesis approach. Finally, we demonstrate the applicability of the methodology to a concrete floor heating system of a real family house.

Online and Proactive Vehicle Rerouting with Uppaal Stratego

“…Some of the experiments took several days. To combat this, partitioning could be a possibility as done in Larsen et al (11). However, we expect this would yield slightly worse results.…”

Analytical Design and Performance Validation of Finite Set MPC Regulated Power Converters

“…Statistical model checking is a well known technique used in aeronautics and embedded automotive systems, sensor networks, and communication systems to provide solutions to problems that are beyond the abilities of classical formal techniques [33]- [35]. As explained in the state of the art we can distinguish three approaches for stability and performance verification: multiple simulations, experiments and analytical analysis using the Lyapunov stability criteria.…”

$$\mathsf {StocHy}$$ : Automated Verification and Synthesis of Stochastic Processes

“…Whilst earlier instances of shs have a long history, shs proper have been thoroughly investigated only from the mid 2000s, and have been most recently applied to the study of complex systems, both engineered and natural. Amongst engineering case studies, shs have been used for modelling and analysis of micro grids [29], smart buildings [23], avionics [7], automation of medical devices [3]. A benchmark for shs is also described in [10].…”