SLAM-based augmented reality for the assessment of short-term spatial memory. A comparative study of visual versus tactile stimuli

Abstract

The assessment of human spatial short-term memory has mainly been performed using visual stimuli and less frequently using auditory stimuli. This paper presents a framework for the development of SLAM-based Augmented Reality applications for the assessment of spatial memory. An AR mobile application was developed for this type of assessment involving visual and tactile stimuli by using our framework. The task to be carried out with the AR application is divided into two phases: 1) a learning phase, in which participants physically walk around a room and have to remember the location of simple geometrical shapes; and 2) an evaluation phase, in which the participants are asked to recall the location of the shapes. A study for comparing the performance outcomes using visual and tactile stimuli was carried out. Fifty-three participants performed the task using the two conditions (Tactile vs Visual), but with more than two months of difference (within-subject design). The number of shapes placed correctly was similar for both conditions. However, the group that used the tactile stimulus spent significantly more time completing the task and required significantly more attempts. The performance outcomes were independent of gender. Some significant correlations among variables related to the performance outcomes and other tests were found. The following significant correlations among variables related to the performance outcomes using visual stimuli and the participants’ subjective variables were also found: 1) the greater the number of correctly placed shapes, the greater the perceived competence; 2) the more attempts required, the less the perceived competence. We also found that perceived enjoyment was higher when a higher sense of presence was induced. Our results suggest that tactile stimuli are valid stimuli to exploit for the assessment of the ability to memorize spatial-tactile associations, but that the ability to memorize spatial-visual associations is dominant. Our results also show that gender does not affect these types of memory tasks.

A SLAM-based augmented reality app for the assessment of spatial short-term memory using visual and auditory stimuli

“…Our proposal is totally configurable and the supervisor can customize the sounds to be used and can place them in any environment. Another little explored sense is that of touch [45]. If these senses were used individually or in combination they could be of great help for spatial memory tasks.…”

Involvement in bullying and sleep disorders in Chinese early adolescents

“…The participants who were physically bullied were most likely to report sleep disorders. This may be because they received tactile, visual, and other stimuli simultaneously, which left a deeper impression on them ( 37 ). We also found that victims of cyberbullying had the highest risk of sleep disorders.…”

Visualization and Interaction Technologies in Serious and Exergames for Cognitive Assessment and Training: A Survey on Available Solutions and Their Validation

“…A comparison of the effect of VR and AR spatial memory training on short-term and long-term memory, has shown that, even if VR outperforms AR in the immediate posttraining test, AR is better suitable for long-term spatial memory transfer [57]. Nonetheless, physical displacements have been shown to be important in acquiring spatial ability skills [58]. Solutions combining non-immersive VR and AR technologies also exist.…”

“…Touchscreen surface [3]- [5], [7], [13], [16], [19], [21], [26], [31]- [33], [36], [37], [39], [41], [43], [44], [48], [50], [58], [59], [85], [118], [121]- [127], [129]- [145], [160]- [168], [199], [225], [232] 60…”