Design and Implementation of Data-Based Validation and Evaluation System for Combat System Engineering

Abstract

The development of combat systems requires validation and evaluation (V&E) at all phases of the V process. In the V process, two types of data should be obtained for the V&E activities: simulation data for the requirement analysis phase and real-world data for the evaluation phases. In this paper, we propose a data-based V&E system (DVES) that can be utilized for all phases of the V process. The proposed system consists of a data collection module and a V&E module. The data collection module is a file system for collecting two-typed data and contains a data distribution service interface to interoperate with real systems. The V&E module loads the data and performs practical V&E functions such as validating a submarine's tactical behaviors or evaluating detection errors of a radar system. We conducted experiments in a submarine's hardware-in-the-loop simulation environment to test the proposed system. The experimental results showed that the proposed system could successfully validate optimized engagement simulation tactics. In addition, we could derive radar performance evaluations and validate torpedo launch procedures. We expect the proposed work to be significant in providing a system for integrated V&E during the development phase of combat systems. Data-based validation, data-based evaluation, combat system engineering, data analysis, validation and evaluation. INDEX TERMS