Scientific computer simulation review

Abstract

a b s t r a c tBefore the results of a scientific computer simulation are used for any purpose, it should be determined if those results can be trusted. Answering that question of trust is the domain of scientific computer simulation review. There is limited literature that focuses on simulation review, and most is specific to the review of a particular type of simulation. This work is intended to provide a foundation for a common understanding of simulation review. This is accomplished through three contributions. First, scientific computer simulation review is formally defined. This definition identifies the scope of simulation review and provides the boundaries of the review process. Second, maturity assessment theory is developed. This development clarifies the concepts of maturity criteria, maturity assessment sets, and maturity assessment frameworks, which are essential for performing simulation review. Finally, simulation review is described as the application of a maturity assessment framework. This is illustrated through evaluating a simulation review performed by the U.S. Nuclear Regulatory Commission. In making these contributions, this work provides a means for a more objective assessment of a simulation's trustworthiness and takes the next step in establishing scientific computer simulation review as its own field.Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Radiotherapy Treatment plannINg study Guidelines (RATING): A framework for setting up and reporting on scientific treatment planning studies

“…This can be accomplished using credit scores indicating their trustworthiness. This work aims to enhance treatment planning study quality by presenting a maturity assessment framework [14] including a numerical scoring (RATING). Background on the development of this framework is presented in the supplementary material.…”

Unified Framework and Survey for Model Verification, Validation and Uncertainty Quantification

“…Therefore it is crucial that VV&UQ is accompanied by overall maturity assessment procedures, such as the Predictive Capability Maturity Model (PCMM), the Phenomenon Identification Ranking Table (PIRT) or the gap-analysis, to increase the credibility of simulation for decision-making. The interested reader is referred to [24,88,100,134].…”

Towards Smart Working: Integration of Computer Simulation, Robotics and Measurement in Process in the Design of a Manufacturing Cell

“…O objetivo de uma simulação computacional é prever com precisão algum comportamento do universo físico, porém, somente isto não torna uma simulação útil [16]. Os resultados de uma simulação são encontrados quando a informação gerada por este é utilizada em uma aplicação.…”