No abstract

Increasing system complexity has provided the impetus to develop new and novel systems engineering methodologies. One of these methodologies is set‐based design (SBD), a concurrent design methodology well suited for complex systems subject to significant uncertainty. Since the 1990s, numerous private, public, and defense sector design programs have successfully implemented SBD. However, concerns regarding SBD's complexity, tendency toward qualitative methods, and lack of quantitative tools have limited its use. To address these issues, our research surveys 122 refereed journal articles and conference papers to assess SBD's state‐of‐practice and identify relevant research opportunities. To accomplish these tasks, we perform a structured literature review to identify and assess relevant and influential research. We found that SBD's state‐of‐practice relies heavily upon decision and tradespace analysis with increasing emphasis on uncertainty modeling and MBSE. We found that the majority of SBD research consists of quantitative methodologies focusing on component and small system applications. We also found that complex system applications used mostly qualitative methodologies. We identify SBD research opportunities for requirements development, MBSE, uncertainty modeling, multiresolution modeling, adversarial analysis, and program management. Finally, we recommend the development of a comprehensive SBD methodology and toolkit, suited for complex system design across all stages of the product development life cycle.

Developing nation-conflict forecasting models is of vital importance to international resource allocation strategies that affect regional and worldwide security and stability. A nation in conflict may evolve very differently to one that is not. Using a unique set of open-source data, a suite of region-specific models are developed that predict nation-state transitions into and out of violent conflict. Conflict transition predictor variables differ not only between the regions, but also within each region dependent on if a nation is identified as in conflict or not. Accurate modeling of complex regional environments is achieved with parsimonious and interpretable models. While we ensure the causal variables of the previous study are considered for inclusion in the models developed, this paper focuses on the ability to accurately predict conflict over individual independent variable analysis.

Engineering complex systems is an exercise in sequential multiobjective decision making under uncertainty. One method for handling this complexity and uncertainty is set-based design (SBD). SBD is a concurrent engineering and management methodology that develops, analyzes, and matures numerous design options, reducing risk and delivering higher value to the stakeholders and end users. SBD accomplishes this through controlled design space convergence which reduces uncertainty and prevents premature design decisions. While SBD has been the subject of numerous scholarly articles, there is limited research providing quantitative methodologies that inform decisions enabling design maturation and convergence. We present a value of information (VOI) based methodology for multiobjective decision problems, and demonstrate its applicability for SBD decisions. We apply Bayesian decision models and information value to inform multiobjective modeling and design maturation decisions. Research contributions include: 1) a framework integrating VOI into the SBD process, 2) a multiobjective VOI method assessing a higher-resolution model's ability to reduce uncertainty, and 3) a means of informing modeling decisions by comparing multiple high resolutions models, given their usage cost and their potential to deliver information value.Finally, we demonstrate the inherent issues associated with premature decisions and traditional point-based design approaches which run the risk of selecting an alternative that later proves infeasible.

This paper examines the potential to use Model-Based Systems Engineering (MBSE) tools to perform trade-off analysis of alternative systems decisions in the system life cycle from the concept stage to the retirement stage. Specially, we searched for integrated models that automate the simultaneous evaluation of the performance, effectiveness, stakeholder value, and cost of multiple alternative system designs. We used the Web of Science to perform a literature search to identify published papers that describe the use of MBSE tools to support automated analysis of alternatives and trade-off analyses. We found very few papers that claimed to use MBSE to provide analysis of design alternatives or tradespace exploration. Based on the literature search insights, we identify and describe the required and desired capabilities to perform automated trade-off analyses of performance, effectiveness, stakeholder value, and cost for multiple system design alternatives using integrated models.