Fidelity evaluation framework

Schricker, Bradley C.; Franceschini, Robert W.; Johnson, Teresa

doi:10.1109/simsym.2001.922122

Cited by 19 publications

(10 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is not yet a full and definitive agreement on the variables to consider for producing or assessing the reliability of simulators [28]- [30], even if the term fidelity is used as an umbrella of all the issues contributing to replicating the actual environment [25] in its specific contextual conditions. Anyhow, it is worth mentioning some well-established references addressing some of the subcategories contributing to the overall simulator fidelity.…”

Section: A Simulator Fidelitymentioning

confidence: 99%

Perception of Driving Simulations: Can the Level of Detail of Virtual Scenarios Affect the Driver's Behavior and Emotions?

Shi

Boffi

Piga

et al. 2022

IEEE Trans. Veh. Technol.

View full text Add to dashboard Cite

Human factors studies are becoming more and more crucial in the automotive sector due to the need to evaluate the driver's reactions to the increasingly sophisticated drivingassistant technologies. Driving simulators allow performing this kind of study in a controlled and safe environment. However, the driving simulation's Level of Detail (LOD) can affect the users' perception of driving scenarios and make an experimental campaign's outcomes unreliable. This paper proposes a study investigating possible correlations between driver's behaviors and emotions, and simulated driving scenarios. Four scenarios replicating the same real area were built with four LODs from LOD0 (only the road is drawn) to LOD3 (all buildings with real textures for facades and roofs are inserted together with items visible from the road). 32 participants drove in all the four scenarios on a fixed-base driving simulator; their performance relating to the vehicle control (i.e. speed, trajectory, brake and gas pedal use, and steering wheel), their physiological data (electrodermal activity, and eye movements), their subjective perceptions, opinions and emotional state (questionnaires concerning the research and Self-Assessment Manikin Scale) were measured. The results showed that driver's behavior changes in a very complex way. Geometrical features of the route and environmental elements constrain much more driving behavior than LOD does, as observed for vehicle trajectory and speed; skin conductance and gas pedal appear to be more sensitive to LODs. Gaze position changes according to LODs, but differently for rectilinear and curvilinear segments. Pupil diameter increases with higher LODs. Emotions are not affected by LODs. Generally, different signals showed different correlations with the LOD level, suggesting that future studies should consider their measures while modeling the virtual scenario. It is hypothesized that scenario realism is more relevant during leisurely environmental interaction, whilst simulator fidelity is crucial in task-driven interactions.

show abstract

Section: A Simulator Fidelitymentioning

confidence: 99%

Perception of Driving Simulations: Can the Level of Detail of Virtual Scenarios Affect the Driver's Behavior and Emotions?

Shi

Boffi

Piga

et al. 2022

IEEE Trans. Veh. Technol.

View full text Add to dashboard Cite

show abstract

“…Failure to do so is likely to cause a negative user experience and make it difficult for the participant to reflect on the usability of a prototype. However, it can be argued that highfidelity components may partly compensate for low-fidelity components if they interact closely (Schricker, Franceschini, & Johnson, 2001). If all fidelity dimensions meet the requirements of a specific test subject ( ), simulation acceptance is achieved.…”

Section: Simulation Acceptance Modelmentioning

confidence: 99%

Fidelity Considerations for Simulation-Based Usability Assessments of Mobile ICT for Hospitals

Dahl

Alsos

Svanæs

2010

International Journal of Human-Computer Interaction

View full text Add to dashboard Cite

Controlled laboratory-based usability assessments of mobile information and communications technologies (ICT) for hospitals have been conducted. As part of these assessments, clinicians have acted out mobile work scenarios and used the systems to solve related tasks. The evaluations show that relevant usability issues go beyond those of graphical user interfaces. Many of these usability issues only show up when the real-world context of use is replicated in the laboratory to a high degree of fidelity. The complexity of the context of use for mobile ICT in hospitals has motivated us to explore training simulation fidelity theories. Based on a review of the training simulation literature, a set of fidelity dimensions through which training simulations are often adjusted to meet specific goals are identified. It is argued that the same mechanisms can be used in usability assessments of mobile ICT for hospitals. Our argument is substantiated by using the identified set of fidelity dimensions in a retrospective analysis of two usability assessments. The analysis explains how the configuration of fidelity dimensions, each reflecting various degrees of realism vis-à-vis the actual performance context, contributed to the identification of relevant usability issues.

show abstract

“…As a preliminary study of fidelity, Schricker et al 13 proposed the Fidelity Evaluation Framework (FEF) to measure fidelity in an absolute and quantitative way, and Roza et al 14 presented a Fidelity Management Framework to provide a structural approach for specifying fidelity characterization, and compared previous research works that can be classified into two groups: singular fidelity metrics and complex multiple-dimensional fidelity metrics.…”

Section: Prior Researchmentioning

confidence: 99%

On fidelity and model selection for discrete event simulation

2010

View full text Add to dashboard Cite

In simulation, perhaps the most common use of the term 'fidelity' refers to the faithfulness with which model behavior reflects modeled system behavior. While there have been studies of fidelity seeking absolute and quantitative measures, there is not yet a consensus on a workable fidelity metric. We propose a formal modeling framework for comparing discrete event system simulation models in terms of fidelity, using a relative fidelity indicator. Based on the framework, we consider the possibility that the higher fidelity simulation models can also be more productive, even though they are more expensive to develop and use, since they can be used to achieve multiple objectives. First, we propose a formal simulation modeling framework within which the fidelity of simulation models can be discussed. With this framework and a simple example, we then define a relative fidelity indicator that provides a systematic way of comparing the fidelity of two simulation models. The relative fidelity indicator focuses on the most important characteristics in simulation studies: the input and output interfaces and the variables used for specifying a real-world system and simulation models. It does not require any special modeling formalism for model comparison. Based on the relative fidelity indicator and simulation modeling framework, we state the optimum simulation model selection problem to achieve given simulation objectives. Under a practical assumption, we analyze the simulation model selection problem and derive properties related to simulation modeling and the fidelity of simulation models.

show abstract

Fidelity evaluation framework

Cited by 19 publications

References 0 publications

Perception of Driving Simulations: Can the Level of Detail of Virtual Scenarios Affect the Driver's Behavior and Emotions?

Perception of Driving Simulations: Can the Level of Detail of Virtual Scenarios Affect the Driver's Behavior and Emotions?

Fidelity Considerations for Simulation-Based Usability Assessments of Mobile ICT for Hospitals

On fidelity and model selection for discrete event simulation

Contact Info

Product

Resources

About