An Augmented Reality Serious Game for Learning Intelligent Wheelchair Control: Comparing Configuration and Tracking Methods

Abstract

This work proposes an augmented reality serious game (ARSG) for supporting individuals with motor disabilities while controlling robotic wheelchairs. A racing track was used as the game narrative; this included restriction areas, static and dynamic virtual objects, as well as obstacles and signs. To experience the game, a prior configuration of the environment, made through a smartphone or a computer, was required. Furthermore, a visualization tool was developed to exhibit user performance while using the ARSG. Two user studies were conducted with 10 and 20 participants, respectively, to compare (1) how different devices enable configuring the ARSG, and (2) different tracking capabilities, i.e., methods used to place virtual content on the real-world environment while the user interacts with the game and controls the wheelchair in the physical space: C1—motion tracking using cloud anchors; C2—offline motion tracking. Results suggest that configuring the environment with the computer is more efficient and accurate, in contrast to the smartphone, which is characterized as more engaging. In addition, condition C1 stood out as more accurate and robust, while condition C2 appeared to be easier to use.

Combined extended reality and reinforcement learning to promote healthcare and reduce social anxiety in fragile X syndrome: a new assessment tool and a rehabilitative strategy

“…Their use may be considered a crucial and invaluable resource because those technologies provide high levels of ecological validity (i.e., with situations similar to real life) and provide researchers and clinicians with practical knowledge through behavioral tracking and experimental control (Liu et al, 2022 ; Perera et al, 2022 ). Matched with serious games (SRs), those technologies may easily pursue educational, funny, diagnostic, and rehabilitative purposes (Hossain et al, 2016 ; Ávila et al, 2017 ; Maio et al, 2022a ). By merging FXS and XR in Scopus, no records were found, suggesting that further research in this specific area was warranted.…”