Metareasoning refers to reasoning about one's own decision making process. This paper considers metareasoning about the decision making process in multi-agent settings. We present a multiagent metareasoning approach that enables a multi-agent team to select which task allocation algorithm to use as a function of changing communication quality level. Given a set of multi-agent task allocation algorithms, we synthesize a policy that prescribes the best algorithm to use among a predefined set of algorithms for a given communication level. Since each agent in the team runs the same policy, the team (or a part of the team) will collectively switch between task allocation algorithms as a function of the observed level of communication. We apply reactive synthesis to generate the policy from high-level specifications written in Linear Temporal Logic encoding the agents' switching behavior with respect to the state of the environment. We perform experiments in simulation to identify the best performing algorithms under different communication levels. The communication environment is modeled using the Rayleigh fading model and communication estimation is done through the exchange of heartbeat messages among agents. We test our metareasoning policy in three types of scenarios: search & rescue, fire monitoring, and ship protection scenarios. For each scenario, we demonstrate that our policy achieved better performance with respect to either max distance traveled, max number of transmitted messages or both compared to running any single algorithm.
Autonomous multiagent systems can be used in different domains such as agriculture, search and rescue, and fire protection because they can accomplish large missions more quickly and robustly by dividing them into separate tasks. Using multiple agents introduces additional complexity, which makes autonomous reasoning and decision making more challenging, however. Because agents such as ground robots, unmanned air vehicles, and autonomous underwater vehicles may have limited computational resources, they may need computationally efficient yet powerful reasoning algorithms (decision-making processes that perform deliberation and means-end reasoning). Metareasoning, which is reasoning about these reasoning algorithms, offers a way to tackle these challenges by monitoring and controlling reasoning algorithms to improve agent and system performance. Although metareasoning approaches for individual computational agents have been studied, no survey of metareasoning in multiagent systems (MAS) has yet appeared. This survey fills the existing gap by discussing the multiagent metareasoning approaches that have been studied in the literature. It identifies metareasoning structures, applications of metareasoning to reasoning problems, and the modes (techniques) used to control reasoning processes. This survey contributes to the study of MAS by providing a framework for discussing multiagent metareasoning, highlighting successful approaches, and indicating areas where future work may be fruitful.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.