Analysis and Requirement Generation for Defense Intelligence Search: Addressing Data Overload through Human–AI Agent System Design for Ambient Awareness

Abstract

This research addresses the data overload faced by intelligence searchers in government and defense agencies. The study leverages methods from the Cognitive Systems Engineering (CSE) literature to generate insights into the intelligence search work domain. These insights are applied to a supporting concept and requirements for designing and evaluating a human-AI agent team specifically for intelligence search tasks. Domain analysis reveals the dynamic nature of the ‘value structure’, a term that describes the evolving set of criteria governing the intelligence search process. Additionally, domain insight provides details for search aggregation and conceptual spaces from which the value structure could be efficiently applied for intelligence search. Support system designs that leverage these findings may enable an intelligence searcher to interact with and understand data at more abstract levels to improve task efficiency. Additionally, new system designs can support the searcher by facilitating an ‘Ambient Awareness’ of non-selected objects in a large data field through relevant system cues. Ambient Awareness achieved through the supporting concept and AI teaming has the potential to address the data overload problem while increasing the breadth and depth of search coverage.