Assessment of Gamified Mixed Reality Environments for Upper Limb Robotic Rehabilitation: Pilot Study on Healthy Adults

Abstract

Exoskeletons for rehabilitation have the potential to aid movement and promote intensive, task-oriented, and personalized motor training. However, robotic-assisted training and user experience could be further improve by including Mixed Reality Environments (MREs) and using a gamification approach. This paper presents the design and evaluation of a MR solution based on Microsoft Hololens 2 for robot-assisted bilateral shoulder training. It is based on gamified MREs designed to guide and encourage bilateral synchronous and asynchronous movements of the upper extremities while a 6 Degrees of Freedom (DOF) ex-oskeleton (FLOAT) provides motor assistance only to the impared limb. The robotic-assisted bimanual tasks involve the use of rehabilitative tools (such as a dowel rod), as a means to interact with the virtual world and to enable the intact limb guide and control the motions of the disable limb. The gamified MR training solution generates meaningful performance metrics from the kinematic analysis of hands movement, captured by Hololens. The subjective evaluation of the gamified MR solution focused on usability, cognitive load, and user experience. Meanwhile, the objective evaluation encompassed the analysis of the robot-assisted movements with and without gamified MREs, a comparative analysis between metrics obtained from Hololens and Vicon data, and the collection of reference data and trajectories. There were twenty-one healthy adults involved in the evaluation of the system. The results with the gamified MREs highlight 1 excellent system usability, low cognitive load, and high user experience. Additionally , integrating gamified MREs into robot-assisted movements enhances shoulder movements. Data collection with Hololens demonstrated to be reliable and consistent. Furthermore, the normal reference values, paths, and velocity profiles obtained from healthy individuals offer a foundation for assessing the performance of individuals with disabilities. In summary, the introduction of gamified MREs for robot-assisted bilateral shoulder movements marks a significant and promising advancement in rehabilitation technology.