MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system

Gama, Alana Elza Fontes da; Chaves, Thiago; Figueiredo, Lucas; Baltar, Adriana; Ma, Meng; Navab, Nassir; Teichrieb, Verônica; Fallavollita, Pascal

doi:10.1016/j.cmpb.2016.07.014

Cited by 76 publications

(87 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The Magic Mirror was tested and evaluated by 748 first and second semester medical students at the Anatomy Department at the Klinikum der Universität München, Germany, and the learning outcomes were extremely positive, particularly with respect to three dimensional understanding of organs and better comprehension of anatomical structures. Preliminary work in rehabilitation research [40,41] resulted in two publications in 2016. The first introduced a MirrARbilitation system that improves patient exercise engagement and performance quality.…”

Section: Related Publicationsmentioning

confidence: 99%

Innovative Technologies for Medical Education

Fallavollita¹

2017

Human Anatomy - Reviews and Medical Advances

Self Cite

View full text Add to dashboard Cite

This chapter aims to assess the current practices of anatomy education technology and provides future directions for medical education. It begins by presenting a historical synopsis of the current paradigms for anatomy learning followed by listing their limitations. Then, it focuses on several innovative educational technologies, which have been introduced over the past years to enhance the learning. These include E-learning, mobile apps, and mixed reality. The chapter concludes by highlighting future directions and addressing the barriers to fully integrating the technologies in the medical curriculum. As new technologies continue to arise, this process-oriented understanding and outcome-based expectations of educational technology should be embraced. With this view, educational technology should be valued in terms of how well the technological process informs and facilitates learning, and the acquisition and maintenance of clinical expertise.

show abstract

Section: Related Publicationsmentioning

confidence: 99%

Innovative Technologies for Medical Education

Fallavollita¹

2017

Human Anatomy - Reviews and Medical Advances

Self Cite

View full text Add to dashboard Cite

show abstract

“…Several AR systems have used a variety of interaction methods such as gloves [15], [19], real objects [1], [13], [14], small markers attached to the hand [11] and contact-less tracking [7], [18]. Thereby, different visualization styles have been used, such as monitors [7], [14], [18], [19] and 2D or 3D rendering in direct environment of the patient (2D: [11], [13], 3D: [1], [15]). …”

Section: Introductionmentioning

confidence: 99%

Towards Engaging Upper Extremity Motor Dysfunction Assessment Using Augmented Reality Games

Cidota

Lukosch

Bank

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

View full text Add to dashboard Cite

Advances in technology offer new opportunities for a better understanding of how different disorders affect motor function. Our aim is to explore the potential of augmented reality (AR) using free hand and body tracking to develop engaging games for a uniform, cost-effective and objective evaluation of upper extremity motor dysfunction in different patient groups. Based on the insights from a study with 20 patients (10 Parkinson's Disease patients and 10 stroke patients) who performed hand/arm movement tasks in AR, we created a set of different augmented reality games for upper extremity motor dysfunction assessment.

show abstract

“…Several AR systems have used a variety of interaction methods such as gloves [26], [33], real objects [1], [23], [25], small markers attached to the hand [19] and contact-less tracking [10], [31]. Thereby, different visualization styles have been used, such as monitors [10], [25], [31], [33], 2D or 3D rendering in direct environment of the patient (2D: [19], [23], 3D: [1], [26]). …”

Section: Introductionmentioning

confidence: 99%

[POSTER] Hybrid Video/Optical See-Through HMD

Cutolo

Fontana

Carbone

et al. 2017

2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)

View full text Add to dashboard Cite

Advances in technology offer new opportunities for a better understanding of how different disorders affect motor function. In this paper, we explore the potential of an augmented reality (AR) game implemented using free hand and body tracking to develop a uniform, cost-effective and objective methods for evaluation of upper extremity motor dysfunction in different patient groups. We conducted a study with 20 patients (10 Parkinson's Disease patients and 10 stroke patients) who performed hand/arm movement tasks in four different conditions in AR and one condition in real world. Despite usability issues mainly due to non-robust hand tracking, the patients were moderately engaged while playing the AR game. Our findings show that moving virtual objects was less targeted, took more time and was associated with larger trunk displacement and a lower variability of elbow angle and upper arm angle than moving real objects. No significant correlations were observed between characteristics of movements in AR and movements in the real world. Still, our findings suggest that the AR game may be suitable for assessing the hand and arm function of mildly affected patients if usability can be further improved.

show abstract

MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system

Abstract: The proposed system proved to be efficient by improving the user engagement and exercise performance outcomes. The results also suggest that the use of biomechanical standards to recognize movements is valuable in guiding users during rehabilitation exercises.

Cited by 76 publications

References 23 publications

Innovative Technologies for Medical Education

Innovative Technologies for Medical Education

Towards Engaging Upper Extremity Motor Dysfunction Assessment Using Augmented Reality Games

[POSTER] Hybrid Video/Optical See-Through HMD

Contact Info

Product

Resources

About