Live–virtual–constructive simulation for testing and evaluation of air combat tactics, techniques, and procedures, Part 2: demonstration of the framework

Abstract

In this paper, the use of the live (L), virtual (V), and constructive (C) simulation framework introduced in Part 1 of this two-part study is demonstrated in the testing and evaluation of air combat tactics, techniques, and procedures (TTP). Each TTP consists of rules that describe how aircraft pilots coordinate their actions to achieve goals in air combat. In the demonstration, the initial rules are defined by subject matter experts (SMEs). These rules are refined iteratively in separate C-, V-, and L-simulation stages. In the C-stage, an operationally used C-simulation model is used to provide optimal rules with respect to the probabilities of survival ( Ps) and kill ( Pk) of aircraft without considering human–machine interaction (HMI). In the V-stage, fighter squadrons’ V-simulators and SMEs’ assessment are used to modify these rules by evaluating their applicability with Pk and Ps, as well as HMI measures regarding pilots’ situation awareness, mental workload, and TTP rule adherence. In the L-stage, qualified fighter pilots fly F/A-18C aircraft in a real-life environment. Based on SMEs’ assessment, the TTP rules refined in the C- and L-stages result in acceptable Pk, Ps, and HMI measures in the L-stage. As such, the demonstration highlights the utility of the LVC framework.

Live–virtual–constructive simulation for testing and evaluation of air combat tactics, techniques, and procedures, Part 1: assessment framework

“…In Part 2 16 of this two-part study, the use of the LVC simulation framework is demonstrated. In the demonstration, C-simulations are conducted using a constructive Air Combat Evaluation Model (ACEM).…”

“…The ACEM is a Raytheon built air combat simulation, typically used for studying operational-level requirements, preliminary designs, and the tactical utility of TTP at the engagement level. The V-simulations in Part 2 16 are run in a Boeing-built Weapon Tactics and Situational Awareness Trainer (WTSAT). The WTSAT is a non-motion, high-fidelity flying simulator used for basic and advanced F/A-18 pilot training.…”

“…The WTSAT is a non-motion, high-fidelity flying simulator used for basic and advanced F/A-18 pilot training. The L-simulations in Part 2 16 utilize real F/A-18C aircraft and operational F/A-18 pilots. While both parts of the study concentrate on air combat, the principles of the LVC simulation framework are domain independent.…”

“…In data analysis, the probability level for a significance result can be chosen before the data collection. For example, in Part 2 16 of this study, p < 0.05 is used. If P k and P s are unsatisfactory, the analysis aims to identify the rules that could be revised to improve the overall HMP output.…”

“…In this Part 1, a live–virtual–constructive (LVC) simulation assessment framework for TTP T&E is introduced. In Part 2, 16 the use of this LVC framework is demonstrated with operationally used C- and V-simulators as well as real F/A-18C aircraft and qualified fighter pilots. Unlike LVC simulations, the LVC framework does not attempt to mix the different simulation classes, and thus it avoids the challenges of LVC simulations.…”