Designing for Engagement in Augmented Reality Games to Assess Upper Extremity Motor Dysfunctions

Dezentje, Paul; Cidota, Marina A.; Clifford, Rory M.S.; Lukosch, Stephan; Bank, Paulina J.M.; Lukosch, Heide

doi:10.1109/ismar-mashd.2015.24

Cited by 16 publications

(8 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In order to design a context-fitting game that is motivating for our end-user, we applied a user centered design approach in which medical experts were interviewed as to the details of the transfer effect and PD patients as to their game world preference and cognitive/physical capabilities. In a previous game design and implementation [2,3], we focused on simple functional tasks of the upper extremities, i.e. tasks that allow for *m.a.cidota@tudelft.nl determining the reachable workspace of a patient.…”

Section: Game Designmentioning

confidence: 99%

“…We used free hand tracking for the game interaction. However, this led to an unnatural hand movement, due to the fact that the optimal pose for the hand tracking was with the palm facing the sensor on top of the HMD [2,3]. The present design incorporates a haptic game controller for interaction to allow users to make more natural hand movements.…”

Section: Game Designmentioning

confidence: 99%

See 1 more Smart Citation

A Haptic Serious Augmented Reality Game for Motor Assessment of Parkinson's Disease Patients

Meulen

Cidota

Lukosch

et al. 2016

2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

Self Cite

View full text Add to dashboard Cite

In the clinical community there is a need for assessment tools that allow for objective, quantitative and valid measures of motor dysfunction. In this paper, we report on the design and evaluation of a serious game that engages patients with Parkinson's disease in upper extremity (hand/arm) movements. The game employs augmented reality to show virtual movement targets, i.e. candies falling from a conveyor belt, and a haptic game controller to catch the candies, that is able to acquire quantitative data about the patient's movement. This paper first describes the design process of the game and the system components. Secondly, we present results of our small quantitative evaluation study (N=11, age: 26-60, healthy persons) regarding the usability of the system, the task load and user experience of the game. Our findings show that the system has a relatively good usability and the game is engaging, but there is still need for technical improvement with regard to tracking the controller in 3D space.

show abstract

Section: Game Designmentioning

confidence: 99%

Section: Game Designmentioning

confidence: 99%

A Haptic Serious Augmented Reality Game for Motor Assessment of Parkinson's Disease Patients

Meulen

Cidota

Lukosch

et al. 2016

2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

Self Cite

View full text Add to dashboard Cite

show abstract

“…Eight participants (4 male, 4 female), aged between 52 and 79 (five of these participants were below 65) with various professional backgrounds, participated in a study on engagement [12]. None of the participants had used an AR system before and only half of them indicated to play digital games (only short mobile games).…”

Section: Study On Engagementmentioning

confidence: 99%

“…We explore interaction modalities for flexible, patienttailored assessment that may motivate patients to use their affected upper extremity to its full capability, ultimately leading to better insight into motor dysfunction [10]. Also, in order to obtain feedback on the game design and implementation, we conducted a second user study on game engagement [12].…”

Section: Introductionmentioning

confidence: 99%

Serious Gaming in Augmented Reality using HMDs for Assessment of Upper Extremity Motor Dysfunctions

Cidotã

Lukosch

Dezentje

et al. 2016

I-Com

Self Cite

View full text Add to dashboard Cite

For a better understanding of how different disorders affect motor function, a uniform, standardized and objective evaluation is a desirable goal for the clinical community. We explore the potential of Augmented Reality (AR) combined with serious gaming and free hand tracking to facilitate objective, cost-effective and patient-friendly methods for evaluation of upper extremity motor dysfunction in different patient groups. In this paper, we describe the design process of the game and the system architecture of the AR framework to meet these requirements. Furthermore, we report our findings from two pilot studies we conducted with healthy people aged over 50. First, we present a usability study (n = 5) on three different modalities of visual feedback for natural hand interaction with AR objects (i. e., no augmented hand, partial augmented hand and a full augmented hand model). The results show that a virtual representation of the fingertips or hand improves the usability of natural hand interaction. Secondly, a study about game engagement is presented. The results of this experiment (n = 8) show that there might be potential for engagement, but usability needs to be improved before it can emerge.

show abstract

“…Following earlier experiments with healthy users [12], [29], we conducted a study with 20 patients (10 PD patients and 10 stroke patients) who performed hand/arm movement tasks in four different conditions in AR and one condition in real world. We describe a user experiment, in which we investigated how virtual hand visual feedback, puzzle types and interaction modalities affected the movement of the patients, task load perception, game experience and usability of the AR system.…”

Section: Introductionmentioning

confidence: 99%

Assessing Upper Extremity Motor Dysfunction Using an Augmented Reality Game

Cidota

Bank

Ouwehand

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Self Cite

View full text Add to dashboard Cite

Advances in technology offer new opportunities for a better understanding of how different disorders affect motor function. In this paper, we explore the potential of an augmented reality (AR) game implemented using free hand and body tracking to develop a uniform, cost-effective and objective methods for evaluation of upper extremity motor dysfunction in different patient groups. We conducted a study with 20 patients (10 Parkinson's Disease patients and 10 stroke patients) who performed hand/arm movement tasks in four different conditions in AR and one condition in real world. Despite usability issues mainly due to non-robust hand tracking, the patients were moderately engaged while playing the AR game. Our findings show that moving virtual objects was less targeted, took more time and was associated with larger trunk displacement and a lower variability of elbow angle and upper arm angle than moving real objects. No significant correlations were observed between characteristics of movements in AR and movements in the real world. Still, our findings suggest that the AR game may be suitable for assessing the hand and arm function of mildly affected patients if usability can be further improved.

show abstract

Designing for Engagement in Augmented Reality Games to Assess Upper Extremity Motor Dysfunctions

Cited by 16 publications

References 5 publications

A Haptic Serious Augmented Reality Game for Motor Assessment of Parkinson's Disease Patients

A Haptic Serious Augmented Reality Game for Motor Assessment of Parkinson's Disease Patients

Serious Gaming in Augmented Reality using HMDs for Assessment of Upper Extremity Motor Dysfunctions

Assessing Upper Extremity Motor Dysfunction Using an Augmented Reality Game

Contact Info

Product

Resources

About