Communication Metrics for Human-Autonomy Teaming: Lessons Learned from us Army Gunnery Field Experiments

Abstract

The development of more effective human-autonomy teaming (HAT) will depend on the availability of validated measures of their performance. Communication provides a critical window into a team’s interactions, states, and performance, but much remains to be learned about how to successfully carry over communication measures from the human teaming context to the HAT context. Therefore, the purpose of this paper is to discuss the implementation of three communication assessment methodologies used for two Wingman Joint Capabilities Technology Demonstration field experiments. These field experiments involved Soldiers and Marines maneuvering vehicles and engaging in live-fire target gunnery, all with the assistance of intelligent autonomous systems. Crew communication data were analyzed using aggregate communication flow, relational event models, and linguistic similarity. We discuss how the assessments were implemented, what they revealed about the teaming between humans and autonomy, and lessons learned for future implementation of communication measurement approaches in the HAT context.

Joint human and autonomy teaming for defense: status, challenges, and perspectives

“…27 The integration of HATs can also improve the overall safety and security of military operations. 28 Unmanned systems can, for instance, perform high-risk missions in hazardous environments, such as reconnaissance and surveillance, allowing human soldiers to operate at a safer distance. Further, advanced technologies, such as autonomous vehicles and drones, can be used to support logistics and supply chain operations, thus reducing the risk of casualties due to road accidents or enemy fire.…”