Free-hand interaction with leap motion controller for stroke rehabilitation

Khademi, Maryam; Hondori, Hossein Mousavi; McKenzie, Alison; Dodakian, Lucy; Lopes, Cristina Videira; Cramer, Steven C.

doi:10.1145/2559206.2581203

Cited by 127 publications

(57 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Although promising, it has been advocated that correlation with a clinical score is not sufficient to provide evidence for diagnostic validity [32]. Furthermore, it should be noted that patients were not immersed in a 3D environment in this study [24], but that the game was visualized on a laptop. This is unfortunate, because movement behaviors might have been impacted by the need to translate 2D perception into 3D movements.…”

Section: Introductionmentioning

confidence: 97%

“…Compared to systems focusing on rehabilitation, a requirement for such systems is to generate quantitative, accurate data that are relevant for monitoring disease progression over time, and to evaluate the response to therapeutic interventions. To our knowledge, only Khademi et al [24] combined free-hand interaction with games to develop a system for rehabilitation of stroke patients in which they reported strong correlations between game scores and standard clinical assessment scores (e.g. FuglMeyer [15] and Box-and-Blocks tests [8], [28]).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Assessing Upper Extremity Motor Dysfunction Using an Augmented Reality Game

Cidota

Bank

Ouwehand

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

Advances in technology offer new opportunities for a better understanding of how different disorders affect motor function. In this paper, we explore the potential of an augmented reality (AR) game implemented using free hand and body tracking to develop a uniform, cost-effective and objective methods for evaluation of upper extremity motor dysfunction in different patient groups. We conducted a study with 20 patients (10 Parkinson's Disease patients and 10 stroke patients) who performed hand/arm movement tasks in four different conditions in AR and one condition in real world. Despite usability issues mainly due to non-robust hand tracking, the patients were moderately engaged while playing the AR game. Our findings show that moving virtual objects was less targeted, took more time and was associated with larger trunk displacement and a lower variability of elbow angle and upper arm angle than moving real objects. No significant correlations were observed between characteristics of movements in AR and movements in the real world. Still, our findings suggest that the AR game may be suitable for assessing the hand and arm function of mildly affected patients if usability can be further improved.

show abstract

Section: Introductionmentioning

confidence: 97%

Section: Introductionmentioning

confidence: 99%

Assessing Upper Extremity Motor Dysfunction Using an Augmented Reality Game

Cidota

Bank

Ouwehand

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

show abstract

“…O sensor Leap Motion Controller (LMC) é um hardware que permite por meio da RV criar uma interface de controle para movimentos de mãos e dedos, porém, não requer nenhum contato manual ou toque com o equipamento [29]. É um sistema confiável para medir o desempenho motor, como por exemplo, tempo de reação, coordenação bimanual e trilha de movimento [30].…”

Section: Introductionunclassified

Terapia baseada em realidade virtual usando o Leap Motion Controller para reabilitação do membro superior após acidente vascular cerebral

Soares

Pereira

Figueiredo

et al. 2017

Sci Med

View full text Add to dashboard Cite

Este artigo está licenciado sob forma de uma licença Creative Commons Atribuição 4.0 Internacional, que permite uso irrestrito, distribuição e reprodução em qualquer meio, desde que a publicação original seja corretamente citada. ABSTRACT AIMS: To evaluate the applicability of a virtual reality-based motion sensor for post-stroke upper limb rehabilitation. CASES DESCRIPTION: Three post-stroke patients were subjected to virtual reality training for rehabilitation of their upper limbs using the Leap Motion Controller technology and the game Playground 3D ® for 3 consecutive days. On the first and last days, the Box and Blocks test, the De Melo Eye-Hand Coordination Test, and transcranial magnetic stimulation were applied. On the last day, the patients were evaluated with the Experience Evaluation Form. After the proposed training, a lower motor threshold was observed in both cerebral hemispheres, as well as better performance in the tests that evaluated hand and eye-hand coordination skills. The proposed therapy was well received by the patients. CONCLUSIONS: No adverse effects were observed, and promising and precise results were obtained for the virtual reality-based training using the Leap Motion Controller and Playground 3D ® . The training allowed patients to have an active role in the rehabilitation of strokeinduced upper limb sequelae.

show abstract

“…(force feedback) gloves [15], [19], marker-based tracking [1], contact-less tracking [7], [13]) in different visualization styles (monitors, HMDs [7], 2D projections [10] in direct environment of the patient).…”

Section: Introductionmentioning

confidence: 99%

[POSTER] ChiroChroma: An Augmented Reality Game for the Assessment of Hand Motor Functionality

Goderie

Alashrafov

Jockin

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

View full text Add to dashboard Cite

For a better understanding of how different diseases (e.g. neurovascular diseases, neurodegenerative diseases, and musculoskeletal pain conditions) affect human motor function, a uniform, standardized and objective evaluation is a desirable goal expressed within the clinical community. We explore the capabilities of an augmented reality (AR) game that uses free hand interaction to facilitate an objective assessment of the upper extremity motor dysfunction. First, the design process of the game and the system architecture are described. Second, a study about usability of the AR framework and game engagement is presented based on an experiment we conducted with five patients and ten healthy people. Lastly, a short analysis of the accuracy of the hand data when participants performed "fingers tapping" gesture is done. The results of the study show that even though users experienced the system as physically and mentally demanding, it was engaging enough to make them complete the game. The study also shows that hand data captured is accurate enough to allow a high degree (95%) of pinching gesture recognition.

show abstract

Free-hand interaction with leap motion controller for stroke rehabilitation

Cited by 127 publications

References 17 publications

Assessing Upper Extremity Motor Dysfunction Using an Augmented Reality Game

Assessing Upper Extremity Motor Dysfunction Using an Augmented Reality Game

Terapia baseada em realidade virtual usando o Leap Motion Controller para reabilitação do membro superior após acidente vascular cerebral

[POSTER] ChiroChroma: An Augmented Reality Game for the Assessment of Hand Motor Functionality

Contact Info

Product

Resources

About