Well-defined intended uses: an explicit requirement for accreditation of modeling and simulation applications

Balcı, Osman; Ormsby, William F.

doi:10.1109/wsc.2000.899883

Cited by 20 publications

(13 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A set of acceptability criteria should be specified for each intended use (Balci and Ormsby 2000) of an M&S application in the legal contract signed by the M&S sponsor and developer. Acceptance testing (Balci 1998) is typically conducted by an independent third party, e.g., M&S Certification Agent, to judge if the M&S application meets the prescribed acceptability criteria.…”

Section: Discussionmentioning

confidence: 99%

Quality Assessment, Verification, and Validation of Modeling and Simulation Applications

Balcı

Proceedings of the 2004 Winter Simulation Conference, 2004.

Self Cite

View full text Add to dashboard Cite

Many different types of modeling and simulation (M&S) applications are used in dozens of disciplines under diverse objectives including acquisition, analysis, education, entertainment, research, and training. M&S application verification and validation (V&V) are conducted to assess mainly the accuracy, which is one of many indicators affecting the M&S application quality. Much higher confidence can be achieved in accuracy if a quality-centered approach is used. This paper presents a quality model for assessing the quality of large-scale complex M&S applications as integrated with V&V. The guidelines provided herein should be useful for assessing the overall quality of an M&S application.

show abstract

Section: Discussionmentioning

confidence: 99%

Quality Assessment, Verification, and Validation of Modeling and Simulation Applications

Balcı

Proceedings of the 2004 Winter Simulation Conference, 2004.

Self Cite

View full text Add to dashboard Cite

show abstract

“…More specifically, model validation is the task of determining whether the model represents the SoI well enough to fulfill its intended use(s); the importance of well defined intended uses is discussed by Balci and Ormsby in [73] and by Piersall and Grange in [74]. The validity assessment is conducted via validation metrics.…”

Section: Definition 511 1) Model Validation Is Concerned With Assementioning

confidence: 99%

On Standardized Model Integration : Automated Validation in Aircraft System Simulation

Hällqvist

2019

Linköping Studies in Science and Technology. Licentiate Thesis

View full text Add to dashboard Cite

Designing modern aircraft is not an easy task. Today, it is not enough to optimize aircraft sub-systems at a sub-system level. Instead, a holistic approach is taken whereby the constituent sub-systems need to be designed for the best joint performance. The State-of-the-Art (SotA) in simulating and exchanging simulation models is moving forward at a fast pace. As such, the feasible use of simulation models has increased and additional benefits can be exploited, such as analysing coupled sub-systems in simulators. Furthermore, if aircraft sub-system simulation models are to be utilized to their fullest extent, opensource tooling and the use of open standards, interoperability between domain specific modeling tools, alongside robust and automated processes for model Verification and Validation (V&V) are required.

show abstract

“…Thus, well-defined intended uses significantly enhance the outcome of V&V efforts. Balci and Ormsby (2000) discuss the importance of intended uses and provide examples of hierarchically defined intended uses. Piersall III and Grange (2014) point out that well-defined intended uses are especially important in System-ofSystems (SoS) contexts.…”

Section: Verification and Validationmentioning

confidence: 99%

On Credibility Assessment in Aircraft System Simulation

Eek¹

2016

View full text Add to dashboard Cite

HE aeronautical industry is becoming increasingly reliant on Modeling and Simulation (M&S) for use throughout all system development phases, for system verification, and end-user training. To justify and to utilize the full potential of today's model-based approach and to enable the industrially requested transition towards virtual testing and virtual certification, the development of efficient and industrially applicable methods for M&S credibility assessment is a key challenge. Credibility assessment of an M&S effort using one individual simulation model is undoubtedly a challenging task involving several vital aspects like verification, validation, uncertainty quantification, and model use history. Building confidence in simulator applications in which several individual models are connected and simulated together is even more problematic.This work addresses methods facilitating credibility assessment of simulation models and simulator applications used in aircraft system development. For models of individual aircraft subsystems, like liquid cooling or environmental control systems, an uncertainty aggregation method is proposed that facilitates early model validation through approximate uncertainty quantification. The central idea is to integrate information obtained during component level validation directly into the component equations, and to utilize this information in model level uncertainty quantification. The method is applicable in early development phases when the availability of system level measurement data for traditional model validation purposes is typically very limited. To clarify, the model may describe a system not yet realized, neither in a test rig nor in a test aircraft.In addition to methods intended for models of individual subsystems, this work also proposes a method and an associated tool for credibility assessment of large-scale simulator applications. As a complement to traditional document-centric approaches, static and dynamic credibility information is here presented to end-users directly during simulation. This implies a support for detecting test plan deficiencies, or that a simulator configuration is not a suitable platform for the execution of a particular test. The credibility assessment tool has been implemented and evaluated in two large-scale system simulators for the Saab Gripen fighter aircraft. The work presented herein also includes an industrially applicable workflow for development, validation, and export of simulation models.Thanks to the close connection to industry, some of the research results have already been successfully implemented in operations and are currently in industrial use. T vii Populärvetenskaplig SammanfattningLYGINDUSTRIN förlitar sig i allt högre utsträckning på modellering och simulering inom såväl systemutveckling som verifiering, samt för träning av piloter och flygtekniker. För att kunna styrka och dra maximal nytta av dagens modellbaserade arbetssätt krävs utveckling av effektiv och industriellt relevant metodik för bedömning av tro...

show abstract

Well-defined intended uses: an explicit requirement for accreditation of modeling and simulation applications

Cited by 20 publications

References 0 publications

Quality Assessment, Verification, and Validation of Modeling and Simulation Applications

Quality Assessment, Verification, and Validation of Modeling and Simulation Applications

On Standardized Model Integration : Automated Validation in Aircraft System Simulation

On Credibility Assessment in Aircraft System Simulation

Contact Info

Product

Resources

About