Strategy Synthesis for Autonomous Agents Using PRISM

Giaquinta, Ruben; Hoffmann, R.; Ireland, Murray; Miller, Alice; Norman, Gethin

doi:10.1007/978-3-319-77935-5_16

Cited by 12 publications

(10 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Prism can also be used to perform strategy synthesis (Kwiatkowska 2016;Kavanagh et al 2019;Giaquinta et al 2018), detailing the optimal strategy for a player -the strategy which has the highest probability of winning against an opponent trying to minimise it. This gives a single action from every state which will maximise the player's optimal probability of winning, but it does not evaluate the extent to which any other action is incorrect.…”

Section: Methodsmentioning

confidence: 99%

Gameplay Analysis of Multiplayer Games with Verified Action-Costs

Kavanagh

Miller

2020

Comput Game J

Self Cite

View full text Add to dashboard Cite

Measuring player skill cannot be done by considering their historical success alone as the relative skill of their opponents must be considered along with confounding factors such as luck and circumstance. With a specifically designed game, every possible player action can be attributed a cost, the value by which a player reduces their maximum probability of winning. By considering the costs of the actions made by a player we can obtain a more accurate representation of how skilful they are. We developed such a game, the mobile game RPGLite, and compared the actions players made with the cost values we had calculated. Through this analysis we made several observations about RPGLite which we share here to demonstrate the utility of action-costs for gameplay analysis. We show how they can be used to identify game states which players have difficulty making the best moves from, to measure how players learn over time and to compare the strengths and complexity of the characters of RPGLite. Commercial titles could benefit from similar tools—we discuss the feasibility of applying our approach to more complex games.

show abstract

Section: Methodsmentioning

confidence: 99%

Gameplay Analysis of Multiplayer Games with Verified Action-Costs

Kavanagh

Miller

2020

Comput Game J

Self Cite

View full text Add to dashboard Cite

show abstract

“…In ref. [48], Giaquinta et al presented probabilistic models for autonomous agent search and retrieve missions derived from Simulink models for an unmanned aerial vehicle (UAV) and they show how probabilistic model checking using PRISM model checker has been used for optimal controller generation. They introduced a sequence of scenarios relevant to UAVs and other autonomous agents such as underwater and ground vehicles.…”

Section: Related Workmentioning

confidence: 99%

Hybrid Verification Technique for Decision-Making of Self-Driving Vehicles

Al-Nuaimi

Wibowo

et al. 2021

JSAN

View full text Add to dashboard Cite

The evolution of driving technology has recently progressed from active safety features and ADAS systems to fully sensor-guided autonomous driving. Bringing such a vehicle to market requires not only simulation and testing but formal verification to account for all possible traffic scenarios. A new verification approach, which combines the use of two well-known model checkers: model checker for multi-agent systems (MCMAS) and probabilistic model checker (PRISM), is presented for this purpose. The overall structure of our autonomous vehicle (AV) system consists of: (1) A perception system of sensors that feeds data into (2) a rational agent (RA) based on a belief–desire–intention (BDI) architecture, which uses a model of the environment and is connected to the RA for verification of decision-making, and (3) a feedback control systems for following a self-planned path. MCMAS is used to check the consistency and stability of the BDI agent logic during design-time. PRISM is used to provide the RA with the probability of success while it decides to take action during run-time operation. This allows the RA to select movements of the highest probability of success from several generated alternatives. This framework has been tested on a new AV software platform built using the robot operating system (ROS) and virtual reality (VR) Gazebo Simulator. It also includes a parking lot scenario to test the feasibility of this approach in a realistic environment. A practical implementation of the AV system was also carried out on the experimental testbed.

show abstract

“…RELATED WORKS Formal analysis of autonomous CPS is a challenging field which has received great attention in recent years [1]- [3]. Most research within the formal analysis of energy consumption in CPS is still based on the linear and generic modelling and specification for both fuel and batteries: The authors of [14], [15] assume constant energy consumption at each time step with fixed batteries capacity. Such unrealistic and over-simplified assumptions become a potential impediment to developing trustworthy energy efficient CPS.…”

Section: Wp2 Toolset Developmentmentioning

confidence: 99%

InFoCPS: Integrating Formal Analysis of Cyber-Physical Systems with Energy Prognostics

Kang

Schobbens

2020

2020 9th Mediterranean Conference on Embedded Computing (MECO)

View full text Add to dashboard Cite

This paper is related to dissemination and exploitation of the InFoCPS PhD research project: Failure of Cyber-Physical Systems (CPS) may cause extensive damage. Safety standards emphasize the use of formal analysis in CPS development processes. Performance degradation assessment and estimation of lifetime of energy storage (electric batteries) are vital in supporting maintenance decisions and guaranteeing CPS reliability. Existing formal analysis techniques mainly focus on specifying energy constraints in simplified manners and checking whether systems operate within given energy bounds. Leading to overlooked energy features that impede development of trustworthy CPS. Prognostics and health management (PHM) estimate energy uncertainty and predict remaining life of systems. We aim to utilize PHM techniques to rigorously model dynamic energy behaviors; resulting models are amenable to formal analysis. This project will increase the degree of maintenance of CPS while (non)-functional requirements are preserved correctly.

show abstract

Strategy Synthesis for Autonomous Agents Using PRISM

Cited by 12 publications

References 33 publications

Gameplay Analysis of Multiplayer Games with Verified Action-Costs

Gameplay Analysis of Multiplayer Games with Verified Action-Costs

Hybrid Verification Technique for Decision-Making of Self-Driving Vehicles

InFoCPS: Integrating Formal Analysis of Cyber-Physical Systems with Energy Prognostics

Contact Info

Product

Resources

About