Automating the detection of breaks in continuous user experience with computer games

Abstract

This paper describes an approach towards automating the identification of design problems with three-dimensional mediated or gaming environments through the capture and query of user-player behavior represented as a data schema that we have termed "immersidata". Analysis of data from a study of an educational computer game that we are developing shows that this approach is an effective way to pinpoint potential usability or design problems occurring in unfolding situational and episodic events that can interrupt or break user experience. As well as informing redesign, a key advantage of this cost-effective approach is that it considerably reduces the time evaluators spend analyzing hours of videoed study material. Categories INTRODUCTIONThe non-linear, continuous and real-time interactive nature of three-dimensional mediated or computer/digital gaming environments presents novel challenges to humancomputer interaction. As academia and research enthusiastically adopt and develop computer games for areas such as education, training and entertainment, the need for more considered design and evaluation methods becomes apparent.

Continuous archival and analysis of user data in virtual and immersive game environments

“…We further presented two examples for analysis of immersidata. The first example was to identify game design problems based on breaks [3]. We developed an application termed ISIS (Immersidata analySIS), which firstly queries the database to retrieve the break points and then marks or indexes breaks with video clips to identify the causes of breaks.…”

“…Building on earlier work, Marsh et al [3] hypothesized that zero or near zero immersidata (directional and angular positional and events) generated from immersive environments could be used to identify breaks in users' experience caused from problematic design. By identifying breaks in immersidata and then analyzing the point or duration in which the breaks occur in video recordings of study sessions, they were able to validate their hypothesis and use this information to inform redesign.…”

“…The first example is based on breaks [3], which are defined as the interruptions in users' experience with the game environment. In order to facilitate analysis of breaks, we developed an application termed ISIS (Immersidata analySIS).…”

Biological-Signal-Based User-Interface System for Virtual-Reality Applications for Healthcare

“…In the HCI field, research on the experience of users has become important. HCI experts are investigating user content experience, and the industry is measuring the user experience, researching methods of interpreting the collected data, and designing methods of evaluating contents [15,16]. Measurement of the physiological or physical performance data not only improves our understanding of the physical health but also help us better understand the experience of users by supplementing the results of other methods.…”

Game User Experience Evaluation

“…The evaluation of the user's experience and the closely connected user-centred development of video games have been addressed in numerous publications (cf. Marsh et al 2005;Bostan and Marsh 2010). Several researchers have designed methods to evaluate video games by adopting techniques from the usability field such as usability tests and heuristic evaluations.…”