Fidelity Considerations for Simulation-Based Usability Assessments of Mobile ICT for Hospitals

Abstract

Controlled laboratory-based usability assessments of mobile information and communications technologies (ICT) for hospitals have been conducted. As part of these assessments, clinicians have acted out mobile work scenarios and used the systems to solve related tasks. The evaluations show that relevant usability issues go beyond those of graphical user interfaces. Many of these usability issues only show up when the real-world context of use is replicated in the laboratory to a high degree of fidelity. The complexity of the context of use for mobile ICT in hospitals has motivated us to explore training simulation fidelity theories. Based on a review of the training simulation literature, a set of fidelity dimensions through which training simulations are often adjusted to meet specific goals are identified. It is argued that the same mechanisms can be used in usability assessments of mobile ICT for hospitals. Our argument is substantiated by using the identified set of fidelity dimensions in a retrospective analysis of two usability assessments. The analysis explains how the configuration of fidelity dimensions, each reflecting various degrees of realism vis-à-vis the actual performance context, contributed to the identification of relevant usability issues.

Clinical simulation: A method for development and evaluation of clinical information systems

“…124 Usability may be defined as the ''extent to which a system, 125 product or service can be used by specified users to achieve spec-126 ified goals with effectiveness, efficiency and satisfaction in a spec-127 ified context of use'' [29, p. 3]. When using simulations it is 128 possible to assess the effect of an information system in different 129 contexts as well as evaluating efficiency, satisfaction and effective-130 ness [30]. Efficiency may be defined as ''resources expended in 131 relation to the accuracy and completeness with which users 132 achieve goals'' [29, p. 3], effectiveness may be defined as ''accuracy 133 and completeness with which users achieve specified goals'' [29, p. 134 3], and satisfaction may be defined as ''freedom from discomfort 135 and positive attitudes towards the use of the product'' [29, p. 3].…”

“…This paper describes a methodological approach for using clinical simulations in 30 the design and evaluation of clinical information systems. The method is based on experiences from more 31 than 20 clinical simulation studies conducted at the ITX-lab in the Capital Region of Denmark during the 32 last 5 years.…”

“…50-8.55 Gathering up 9.00-9. 30 Introduction to clinical simulation and IT-system 9.30-9. 40 Hands on 9.…”

“…10 Hands on 13.10-13. 30 Clinical simulation: general practitioner 13. 30-13.50 Clinical simulation: Community nurse 13.50-14.…”

“…30-15.30 De-briefing interview 15.30-16. 30 Instant data analysis and recapitulation of test 900,00 900,00 Another issue to be addressed was the sharing of responsibility. 791 With PCM all healthcare professionals have the same access to all 792 data, but should it be possible for a physician at the hospital to 793 overrule a prescription from the general practitioner -or vice 794 versa?…”