Serious Gaming in Augmented Reality using HMDs for Assessment of Upper Extremity Motor Dysfunctions

Cidotã, Marina-Anca; Lukosch, Stephan; Dezentje, Paul; Bank, Paulina J.M.; Lukosch, Heide; Clifford, Rory M.S.

doi:10.1515/icom-2016-0020

Cited by 14 publications

(8 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Previous studies on technology assistance for rehabilitation and health and fitness can be classified in terms of the used technology and hardware, which range from the application of professional tracking hardware [ 38 ] over virtual and augmented reality HMDs (head mounted displays) [ 39 ] and mainstream gaming hardware [ 40 ] to everyday mobile phones [ 41 - 43 ].…”

Section: Discussionmentioning

confidence: 99%

“…Augmented reality (AR) systems with HMDs (such as the Microsoft HoloLens) allow to graphically overlay the visual perception with additional information, which would be well-suited to provide patients with feedback on exercise performance. The design of AR games for upper extremity motor dysfunctions was investigated [ 47 ] and in a follow-up study, an AR game for an HMD system was evaluated [ 39 ]. However, as compared with a mobile phone, AR HMDs are expensive and not widely available at the moment.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Mobile Phone–Supported Physiotherapy for Frozen Shoulder: Feasibility Assessment Based on a Usability Study

Stütz¹,

Emsenhuber²,

Huber³

et al. 2017

JMIR Rehabil Assist Technol

View full text Add to dashboard Cite

BackgroundPatients with frozen shoulder show limited shoulder mobility often accompanied by pain. Common treatment methods include physiotherapy, pain medication, administration of corticosteroids, and surgical capsulotomy. Frozen shoulder often lasts from months to years and mostly affects persons in the age group of 40 to 70 years. It severely reduces the quality of life and the ability to work.ObjectiveThe objective of this study was to evaluate the feasibility of a mobile health (mHealth) intervention that supports patients affected by “stage two” frozen shoulder. Patients were supported with app-based exercise instructions and tools to monitor their training compliance and progress. These training compliance and progress data supplement the patients’ oral reports to the physiotherapists and physicians and can assist them in therapy adjustment.MethodsIn order to assess the feasibility of the mHealth intervention, a pilot study of a newly developed app for frozen shoulder patients was conducted with 5 patients for 3 weeks. The main function of the app was the instruction for exercising at home. Standardized questionnaires on usability such as System Usability Scale (SUS) and USE (Usefulness, Satisfaction, and Ease of use), and Technology Acceptance Model-2 (TAM-2) were completed by the study participants at the end of the study. Additionally, a nonstandardized questionnaire was completed by all patients. The correctness of the exercises as conducted by the patients was assessed by a physiotherapist at the end of the study. The mobility of the shoulder and pain in shoulder movement was assessed by a physiotherapist at the start and the end of the study.ResultsThe pilot study was successfully conducted, and the app was evaluated by the patients after 3 weeks. The results of the standardized questionnaires showed high acceptance (TAM-2) and high usability (SUS) of the developed app. The overall usability of the system as assessed by the SUS questionnaire was very good (an average score of 88 out of 100). The average score of the TAM-2 questionnaire on the intention to further use the app was 4.2 out of 5, which indicated that most patients would use the app if further available. The results of the USE questionnaires highlighted that the patients learned how to use the app easily (an average score of 4.2 out of 5) and were satisfied with the app (an average score of 4.7 out of 5). The frequency of app usage and training was very high based on patient reports and verified by analysis of the usage data. The patients conducted the exercises almost flawlessly.ConclusionsOur results indicate the feasibility of the mHealth intervention, as the app was easy to use and frequently used by the patients. The app supported the patients’ physiotherapy by providing clear exercising instructions.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Mobile Phone–Supported Physiotherapy for Frozen Shoulder: Feasibility Assessment Based on a Usability Study

Stütz¹,

Emsenhuber²,

Huber³

et al. 2017

JMIR Rehabil Assist Technol

View full text Add to dashboard Cite

show abstract

“…Based on the consultation of 1 clinician, 1 movement scientist and 7 PD patients, we designed the game "post office trouble" [7] which focuses on a simple but functional task, i.e., reaching and grasping an object. The game puts a player in the position of a post office worker who has to sort packages, thereby making as few mistakes as possible.…”

Section: Task Designmentioning

confidence: 99%

[POSTER] Hybrid Video/Optical See-Through HMD

Cutolo

Fontana

Carbone

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

View full text Add to dashboard Cite

Advances in technology offer new opportunities for a better understanding of how different disorders affect motor function. In this paper, we explore the potential of an augmented reality (AR) game implemented using free hand and body tracking to develop a uniform, cost-effective and objective methods for evaluation of upper extremity motor dysfunction in different patient groups. We conducted a study with 20 patients (10 Parkinson's Disease patients and 10 stroke patients) who performed hand/arm movement tasks in four different conditions in AR and one condition in real world. Despite usability issues mainly due to non-robust hand tracking, the patients were moderately engaged while playing the AR game. Our findings show that moving virtual objects was less targeted, took more time and was associated with larger trunk displacement and a lower variability of elbow angle and upper arm angle than moving real objects. No significant correlations were observed between characteristics of movements in AR and movements in the real world. Still, our findings suggest that the AR game may be suitable for assessing the hand and arm function of mildly affected patients if usability can be further improved.

show abstract

“…Based on the consultation of 1 clinician, 1 movement scientist and 7 Parkinson's Disease (PD) patients, we designed the game "post office trouble" [6] which focuses on a simple but functional task, i.e., reaching and grasping an object. The game puts the player in the position of a post office worker who has to sort international packages while making as few mistakes as possible.…”

Section: User Studiesmentioning

confidence: 99%

“…A study on engagement and usability with 8 healthy elderly participants showed that the usability of the game is still quite low, but that there is potential for engagement [6]. Following experiments with healthy users [8], [16], we conducted a study that specifically explored the usability and engagement of different puzzle types (colors/images), interaction modalities (grasping/pointing) and presence of visual feedback of virtual hand (yes/no) in augmented reality.…”

Section: User Studiesmentioning

confidence: 99%

Towards Engaging Upper Extremity Motor Dysfunction Assessment Using Augmented Reality Games

Cidota

Lukosch

Bank

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

Self Cite

View full text Add to dashboard Cite

Advances in technology offer new opportunities for a better understanding of how different disorders affect motor function. Our aim is to explore the potential of augmented reality (AR) using free hand and body tracking to develop engaging games for a uniform, cost-effective and objective evaluation of upper extremity motor dysfunction in different patient groups. Based on the insights from a study with 20 patients (10 Parkinson's Disease patients and 10 stroke patients) who performed hand/arm movement tasks in AR, we created a set of different augmented reality games for upper extremity motor dysfunction assessment.

show abstract

Serious Gaming in Augmented Reality using HMDs for Assessment of Upper Extremity Motor Dysfunctions

Cited by 14 publications

References 21 publications

Mobile Phone–Supported Physiotherapy for Frozen Shoulder: Feasibility Assessment Based on a Usability Study

Mobile Phone–Supported Physiotherapy for Frozen Shoulder: Feasibility Assessment Based on a Usability Study

[POSTER] Hybrid Video/Optical See-Through HMD

Towards Engaging Upper Extremity Motor Dysfunction Assessment Using Augmented Reality Games

Contact Info

Product

Resources

About