The use of simulators based on game software has the potential to deliver effective training. However, simulators with usability problems can interfere with training by presenting unwanted distractions. This report describes an assessment of the usability of a wearable computer system which has been designed to interface with a virtual environment and which can be used for simulator training. Usability of the wearable system was compared with that of a more common desktop interface in a game-based virtual environment. Eight evaluators conducted a heuristic usability evaluation of the wearable system and desktop interfaces. They identified 24 usability concerns with the wearable system and desktop interfaces, and the virtual environment. The majority of the concerns (46%) were with the virtual environment. Forty-two percent of the concerns were related to the wearable system, and the remaining 12% dealt with the desktop interface. However, when the frequency, impact, and persistence scores were aggregated into an overall score, the wearable system had the poorest usability. Eight of the ten greatest usability concerns were related to the wearable system. These data suggest that the virtual environment is more usable with the desktop interface than the wearable system. iii iv
USABILITY OF WEARABLE AND DESKTOP GAME-BASED SIMULATIONS: A HEURISTIC EVALUATION EXECUTIVE SUMMARYResearch Requirement:The use of simulators driven by commercial game software has the potential to deliver effective training. However, how closely the simulator must model the real environment has been a perennial question. The answer often depends on the type of tasks to be simulated. Tasks using motor skills may require very realistic models, whereas tasks employing cognitive skills can be less realistic. Training developers often assume that a simulator which is more realistic will provide better training, but this is not necessarily the case. A simulator which has physical similarity with the real system might not have the functional fidelity necessary to improve student's performance with the real system.Many factors impact upon the training effectiveness of a simulator system, one of which is its usability. Simulators with good usability allow training time to focus on practicing skills to improve performance. Usability problems can interfere with training by shifting the focus from training objectives to the operation of the simulator technology.Commercial wearable computer systems are available which have been designed to interface with a virtual environment and can be used for simulator-based training. While wearable interfaces have great potential for training, at present there is little information available on whether the wearable interface would be an efficient and cost-effective training delivery method.One of the pieces of information which would help evaluate the cost-effectiveness of the wearable system is its usability, that is, how difficult is it to use compared to more common desktop interfaces. The research described in thi...