Motion-Based Serious Games for Hand Assistive Rehabilitation

Afyouni, Imad; Qamar, Ahmad; Hussain, Syed Osama; Rehman, Faizan Ur; Sadiq, Bilal; Murad, Abdullah

doi:10.1145/3030024.3040977

Cited by 22 publications

(42 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…For example, various studies [ 41 , 62 , 65 , 69 , 80 , 82 ] mentioned the possibility of Kinect’s dysfunctionality in detecting movements or parts of the body. Moreover, several studies mentioned poor body part detection using different commercial sensors, such as poor hand detection from the Leap Motion device [ 103 ], poor detection with use of a camera [ 28 ], and poor detection in the combined use of the Leap Motion sensor with Oculus Rift VR goggles [ 104 ].…”

Section: Resultsmentioning

confidence: 99%

“…ROM and data regarding the angles of the hand during its motion constitute another significant group of features that have been commonly used by researchers and health professionals to quantify therapy progress. Several studies [ 12 , 20 , 69 , 81 , 98 , 103 , 152 ] referred to the calculation of these kinds of features. Four studies [ 20 , 69 , 98 , 152 ] reported that they monitored ROM data (minimum, maximum, and average) for each single joint or exercise movement, and only one study [ 12 ] calculated ROM as a summative score of multiple movements or the difference.…”

Section: Resultsmentioning

confidence: 99%

“…With respect to commercial gaming accessories, a few studies focused on individual sensors such as VR headsets [86][87][88], Wii remotes [89][90][91][92][93][94][95], or the P5 glove [96,97] in an attempt to incorporate the existing devices to rehabilitation practices. Another commercial sensor that has attracted researchers' interest is Leap Motion, a hand-tracking sensor, which is most commonly used alone [19,25,40,43,[98][99][100][101][102][103]. One study also combined the Leap Motion sensor and a VR headset [104] in an attempt to create a VR environment for the user as a reinforcement of after-stroke rehabilitation methods.…”

Section: Commercial Sensorsmentioning

confidence: 99%

See 2 more Smart Citations

Serious Gaming Technology in Upper Extremity Rehabilitation: Scoping Review

Koutsiana¹,

Ladakis²,

Fotopoulos³

et al. 2020

JMIR Serious Games

View full text Add to dashboard Cite

Background: Serious gaming has increasingly gained attention as a potential new component in clinical practice. Specifically, its use in the rehabilitation of motor dysfunctions has been intensively researched during the past three decades. Objective: The aim of this scoping review was to evaluate the current role of serious games in upper extremity rehabilitation, and to identify common methods and practice as well as technology patterns. This objective was approached via the exploration of published research efforts over time. Methods: The literature search, using the PubMed and Scopus databases, included articles published from 1999 to 2019. The eligibility criteria were (i) any form of game-based arm rehabilitation; (ii) published in a peer-reviewed journal or conference; (iii) introduce a game in an electronic format; (iv) published in English; and (v) not a review, meta-analysis, or conference abstract. The search strategy identified 169 relevant articles. Results: The results indicated an increasing research trend in the domain of serious gaming deployment in upper extremity rehabilitation. Furthermore, differences regarding the number of publications and the game approach were noted between studies that used commercial devices in their rehabilitation systems and those that proposed a custom-made robotic arm, glove, or other devices for the connection and interaction with the game platform. A particularly relevant observation concerns the evaluation of the introduced systems. Although one-third of the studies evaluated their implementations with patients, in most cases, there is the need for a larger number of participants and better testing of the rehabilitation scheme efficiency over time. Most of the studies that included some form of assessment for the introduced rehabilitation game mentioned user experience as one of the factors considered for evaluation of the system. Besides user experience assessment, the most common evaluation method involving patients was the use of standard medical tests. Finally, a few studies attempted to extract game features to introduce quantitative measurements for the evaluation of patient improvement. Conclusions: This paper presents an overview of a significant research topic and highlights the current state of the field. Despite extensive attempts for the development of gamified rehabilitation systems, there is no definite answer as to whether a serious game is a favorable means for upper extremity functionality improvement; however, this certainly constitutes a supplementary means for motivation. The development of a unified performance quantification framework and more extensive experiments could generate richer evidence and contribute toward this direction.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Commercial Sensorsmentioning

confidence: 99%

See 1 more Smart Citation

Serious Gaming Technology in Upper Extremity Rehabilitation: Scoping Review

Koutsiana¹,

Ladakis²,

Fotopoulos³

et al. 2020

JMIR Serious Games

View full text Add to dashboard Cite

show abstract

“…The authors of [ 13 , 14 ] designed a game-based system for detecting, tracking, and visualizing joint therapy data. Afyouni et al [ 15 ] developed a game to be played with a Leap Motion controller for rehabilitation of the hand movement of upper extremity for the stroke patient. Jonsdottir et al [ 16 ] designed a game framework for arm rehabilitation to motivate patients dealing with multiple sclerosis.…”

Section: Related Workmentioning

confidence: 99%

Adaptive Rehabilitation Bots in Serious Games

Afyouni

Murad

Einea³

2020

Sensors

Self Cite

View full text Add to dashboard Cite

In recent years, we have witnessed a growing adoption of serious games in telerehabilitation by taking advantage of advanced multimedia technologies such as motion capture and virtual reality devices. Current serious game solutions for telerehabilitation suffer form lack of personalization and adaptiveness to patients’ needs and performance. This paper introduces “RehaBot”, a framework for adaptive generation of personalized serious games in the context of remote rehabilitation, using 3D motion tracking and virtual reality environments. A personalized and versatile gaming platform with embedded virtual assistants, called “Rehab bots”, is created. Utilizing these rehab bots, all workout session scenes will include a guide with various sets of motions to direct patients towards performing the prescribed exercises correctly. Furthermore, the rehab bots employ a robust technique to adjust the workout difficulty level in real-time to match the patients’ performance. This technique correlates and matches the patterns of the precalculated motions with patients’ motions to produce a highly engaging gamified workout experience. Moreover, multimodal insights are passed to the users pointing out the joints that did not perform as anticipated along with suggestions to improve the current performance. A clinical study was conducted on patients dealing with chronic neck pain to prove the usability and effectiveness of our adjunctive online physiotherapy solution. Ten participants used the serious gaming platform, while four participants performed the traditional procedure with an active program for neck pain relief, for two weeks (10 min, 10 sessions/2 weeks). Feasibility and user experience measures were collected, and the results of experiments show that patients found our game-based adaptive solution engaging and effective, and most of them could achieve high accuracy in performing the personalized prescribed therapies.

show abstract

Section: Commercial Sensorsmentioning

confidence: 99%

Serious Gaming Technology in Upper Extremity Rehabilitation: Scoping Review (Preprint)

Koutsiana¹,

Ladakis²,

Fotopoulos³

et al. 2020

Preprint

View full text Add to dashboard Cite

BACKGROUND Serious gaming is increasingly gaining attention as a potential new component in clinical practice. Specifically, its use in the rehabilitation of motor dysfunctions has been intensively researched during the past three decades. OBJECTIVE This scoping review aims to evaluate the current role of serious games in the upper extremity rehabilitation and identify common methods and practice, technology patterns as well as gaps. This objective is approached via the exploration of published research efforts over the years. METHODS The literature research, using the PubMed and Scopus databases, included articles published until June 2019. The eligibility criteria were (i) to include any form of introduced game-based arm rehabilitation, (ii) to be a study published in a peer-reviewed journal or conference, (iii) to introduce a game in an electronic format, (iv) to be a study in English, (v) to not be a review, meta-analysis, editorial or commentary. The review identified 169 relevant articles. RESULTS The results indicate an increasing research trend in the domain of serious gaming deployment in upper extremity rehabilitation. Furthermore, differences regarding the number of publications and the game approach were noted between studies which used commercial devices in their rehabilitation systems, with studies which created any type of robotic arm, glove or other devices for the connection with the game platform. A significant observation concerns the evaluation of the introduced systems. Although one-third of the studies evaluate in real use their implementations including patients, in most cases, there is the need for a bigger number of participants and better testing of the rehabilitation scheme efficiency over time. Most of the studies which included some form of assessment for the introduced rehabilitation game, mentioned among others the user experience as a factor for the system’s evaluation. Besides the user experience assessment, the most common evaluation method involving patients was the use of medical standard tests. Finally, a few studies attempted to extract game features in order to introduce quantitative measurements for the evaluation of the patient’s improvement. CONCLUSIONS This paper presents an overview of a significant research topic and highlights the current state of the field. Despite all the attempts for the development of a rehabilitation system, there is not a definite answer of whether a serious game is a favorable means for the upper extremity functionality improvement, but it is certainly constitutes a supplementary means for motivation. The development of a unified performance quantification framework and the conductance of wider scale experiments could generate richer evidence and contribute in this direction.

show abstract

Motion-Based Serious Games for Hand Assistive Rehabilitation

Cited by 22 publications

References 5 publications

Serious Gaming Technology in Upper Extremity Rehabilitation: Scoping Review

Serious Gaming Technology in Upper Extremity Rehabilitation: Scoping Review

Adaptive Rehabilitation Bots in Serious Games

Serious Gaming Technology in Upper Extremity Rehabilitation: Scoping Review (Preprint)

Contact Info

Product

Resources

About