Using model‐based systems engineering as a framework for improving test and evaluation activities

Abstract

Model‐based systems engineering (MBSE) approaches are based on a paradigm shift from document‐centric engineering to model‐based engineering. Although MBSE methods are intended to apply across the entire system life cycle, one area that has not received much attention to date is the role of test and evaluation. Test and evaluation activities provide information that reduces the uncertainty about system performance, effectiveness, and suitability. This uncertainty reduction becomes particularly important within the context of defense systems, which can cost billions of dollars. This paper describes a methodology that uses an MBSE framework and Monte Carlo simulation to define uncertainty reduction goals for test planners to use in developing test strategies and detailed test designs for evaluating technical performance parameters. As tests are completed, physical models can be updated with test data and additional analyses conducted with combat models to determine if the system meets user requirements. The methodology is demonstrated through a simple case study involving a series of tests to predict the landing performance of an aircraft. ©2012 Wiley Periodicals, Inc. Syst Eng 16:

Communication of Simulation and Modelling Activities in Early Systems Engineering

“…Another interesting topic for discussion is whether to integrate such a simulation study into an overall MBSE framework and in what manner. Bjorkman et al 17 already showed that it can be valuable to couple testing procedures to simulation studies, to gain mutual benefits. The Design Framework 22 advocates that it is important to capture design rationale throughout the various lifecycle phases.…”

A framework for integrating reliability and systems engineering: proof‐of‐concept experiences

“…In the MBSE approach, SE activities are shown by use of model of diagrams and hierarchies. Also, it depicts the system requirements, functions, design, as well as verification and test information (Bjorkman, Sarkani, & Mazzuchi, 2013).…”

Model‐based architecture and programmatic optimization for satellite system‐of‐systems architectures

“…Even so, MBSE presents an attractive option that, when implemented correctly, has great value. Numerous studies have attested to the utility and applicability of MBSE to various engineering disciplines, including space systems, information security systems, and test and evaluation . MBSE has been shown to have explicit methods for most design actions, allowing it to serve effectively in an integration role with demonstrated payoffs in supporting conceptual and creative design problems .…”