Ask a(n)droid to tell you the odds: probabilistic security-by-contract for mobile devices

Aldini, Alessandro; Marra, Antonio; Martinelli, Fabio; Saracino, Andrea

doi:10.1007/s00500-020-05299-4

Cited by 4 publications

(1 citation statement)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Besides, linear time properties are also covered in the specification step of the underlying system. Examples of the application of MDPs in this field includes the verification of hardware systems [2,3], computer networks [4,5], cyberphysical and cyber-security systems [6][7][8], medical sciences [9] robotics and software systems [10][11][12][13]. In reinforcement learning, the main focus is to approximate the optimal expected reward (or cost) before reaching a final state [14].…”

Section: Introductionmentioning

confidence: 99%

State ordering and classification for analyzing non-sparse large Markov Models

Mohagheghi

2023

Preprint

View full text Add to dashboard Cite

Markov chains and Markov decision processes have been widely used to model the behavior of computer systems with probabilistic aspects. Numerical and iterative methods are commonly used to analyze these models. Many efforts have been made in recent decades to improve the efficiency of these numerical methods. In this paper, focusing on Markov models with non-sparse structure, a new set of heuristics is proposed for prioritizing model states with the aim of reducing the total computation time. In these heuristics, a set of simulation runs are used for statistical analysis of the effect of each state on the required values of the other states. Under this criterion, the priority of each state in updating its values is determined. The proposed heuristics provide a state ordering that improves the value propagation among the states. The proposed methods are also extended for very large models where disk-based techniques are required to analyze the models. Experimental results show that our proposed methods in this paper reduce the running times of the iterative methods for most cases of non-sparse models.

show abstract