A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs

Abstract

Autonomous underwater vehicles (AUVs) are being tasked with increasingly complex missions. The acoustic communications required for AUVs are, by the nature of the medium, low bandwidth while adverse environmental conditions underwater often mean they are also intermittent. This has motivated development of highly autonomous systems, which can operate independently of their operators for considerable periods of time. These missions often involve multiple vehicles leading not only to challenges in communications but also in command and control (C2). Specifically operators face complexity in controlling multi-objective, multi-vehicle missions, whilst simultaneously facing uncertainty over the current status and safety of several remote high value assets. Additionally, it may be required to perform command and control of these complex missions in a remote control room. In this paper, we propose a combination of an intuitive, natural language operator interface combined with communications that use platforms from multiple domains to relay data over different mediums and transmission modes, improving command and control of collaborative and fully autonomous missions. In trials, we have demonstrated an integrated system combining working prototypes with established commercial C2 software that enables the use of a natural language interface to monitor an AUV survey mission in an onshore command and control centre.

Interoperability Among Unmanned Maritime Vehicles: Review and First In-field Experimentation

“…The final demonstration in the Atlantic Ocean involved ten heterogeneous vehicles but all the technologies designed during the project were conceived and implemented with a specific long term vision: underwater missions performed by a large number of autonomous cooperating robots. Moreover, the system presented in Robb et al (2018) dealt with the difficulty of monitoring multi-objective, multi-vehicle operations, while at the same time resolving the ambiguity about the actual status and the protection of distant, high-value platforms. In order to increase the reliability and efficacy of UMV C2S, the authors suggested a hybrid of an interactive, natural language operator interface coupled with communications using multi-domain channels to transmit data through various devices and delivery modes, enhancing C2 of coordinated and ultimately autonomous missions.…”