Spatial learning and navigation using a virtual verbal display

Giudice, Nicholas A.; Bakdash, Jonathan Z.; Legge, Gordon E.; Roy, Rudrava

doi:10.1145/1658349.1658352

Cited by 13 publications

(11 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are several challenges faced by these sensor-based technologies in indoor environments [16,31], e.g., the high cost of infrastructure construction, the accuracy of localization, and the reliability of signals in complex indoor environments. Moreover, sensor-based localization methods normally anchor the user's location on a 2D map, which requires the users to interpret the map and associate it with the egocentric perception of the environment [18].…”

Section: Introductionmentioning

confidence: 99%

A wearable virtual guide for context-aware cognitive indoor navigation

Lim

et al. 2014

Proceedings of the 16th International Conference on Human-Computer Interaction With Mobile Devices &Amp; Services

View full text Add to dashboard Cite

In this paper, we explore a new way to provide context-aware assistance for indoor navigation using a wearable vision system. We investigate how to represent the cognitive knowledge of wayfinding based on first-person-view videos in real-time and how to provide context-aware navigation instructions in a human-like manner. Inspired by the human cognitive process of wayfinding, we propose a novel cognitive model that represents visual concepts as a hierarchical structure. It facilitates efficient and robust localization based on cognitive visual concepts. Next, we design a prototype system that provides intelligent contextaware assistance based on the cognitive indoor navigation knowledge model. We conduct field tests to evaluate the system's efficacy by benchmarking it against traditional 2D maps and human guidance. The results show that contextawareness built on cognitive visual perception enables the system to emulate the efficacy of a human guide, leading to positive user experience.

show abstract

Section: Introductionmentioning

confidence: 99%

A wearable virtual guide for context-aware cognitive indoor navigation

Lim

et al. 2014

Proceedings of the 16th International Conference on Human-Computer Interaction With Mobile Devices &Amp; Services

View full text Add to dashboard Cite

show abstract

“…Separately, a rich literature on narrative processing has revealed that verbal descriptions of unobserved environments can be effective for generating accurate mental models of environments and routes (Brunyé, Rapp, & Taylor, 2008;Brunyé, Taylor, & Worboys, 2007; Brunyé & Taylor, 2008a, 2008b; Lee & Tversky, 2005; Mani & Johnson-Laird, 1982; Schneider & Taylor, 1999; Taylor & Tversky, 1992a, 1992b), and for online navigation (Giudice et al, 2007, 2010; Meilinger, 2005; Pazzaglia & De Beni, 2001; Tversky & Lee, 1999; but see Wanet-Defalque, Vanlierde, & Michaux, 2001). Here we demonstrate a complementary phenomenon – that in the course of visually encoding an environment, supplementary verbal information is beneficial for reinforcing landmark memory.…”

Section: Methodsmentioning

confidence: 99%

Verbalizing, visualizing, and navigating: The effect of strategies on encoding a large-scale virtual environment.

Kraemer¹,

Schinazi²,

Cawkwell³

et al. 2017

Journal of Experimental Psychology: Learning, Memory, and Cogni

View full text Add to dashboard Cite

Using novel virtual cities, we investigated the influence of verbal and visual strategies on the encoding of navigation-relevant information in a large-scale virtual environment. In two experiments, participants watched videos of routes through four virtual cities and were subsequently tested on their memory for observed landmarks and on their ability to make judgments regarding the relative directions of the different landmarks along the route. In the first experiment, self-report questionnaires measuring visual and verbal cognitive styles were administered to examine correlations between cognitive styles, landmark recognition, and judgments of relative direction. Results demonstrate a tradeoff in which the verbal cognitive style is more beneficial for recognizing individual landmarks than for judging relative directions between them, whereas the visual cognitive style is more beneficial for judging relative directions than for landmark recognition. In a second experiment, we manipulated the use of verbal and visual strategies by varying task instructions given to separate groups of participants. Results confirm that a verbal strategy benefits landmark memory, whereas a visual strategy benefits judgments of relative direction. The manipulation of strategy by altering task instructions appears to trump individual differences in cognitive style. Taken together, we find that processing different details during route encoding, whether due to individual proclivities (Experiment 1) or task instructions (Experiment 2), results in benefits for different components of navigation relevant information. These findings also highlight the value of considering multiple sources of individual differences as part of spatial cognition investigations.

show abstract

“…For navigation without vision, an example of stereo sound would be the verbal description of "There is a 40 foot hallway to your left" is heard in the left ear as opposed to a monaural sound. When an environment is learned without vision via monaural verbal descriptions, spatial knowledge is impaired relative to sighted navigation (Giudice, Bakdash, Legge, & Roy, 2010), but this detriment can be reversed using spatial audio (Giudice & Tietz, 2008). An additional benefit of stereo sound is that it has lower demands on working memory than monaural sound (Klatzky et al, 2006).…”

Section: Auditory Aidsmentioning

confidence: 99%

Guided Navigation Impairs Spatial Knowledge: Using Aids to Improve Spatial Representations

Bakdash¹

2020

Preprint

View full text Add to dashboard Cite

Successful navigation generally requires an accurate spatial representation of the environment. However, under guided navigation (i.e. route directions are provided by a GPS system or car passenger) no detailed representation of space is necessary because one only needs to follow directions. The first experiment separated components of navigation, spatial decision-making (planning and selection of routes) and navigational control (executing complex actions such as stopping and steering) for environmental learning. Spatial knowledge was assessed using multiple measures (spatial updating using immersive, head-mounted virtual reality and map construction). More accurate environmental knowledge was acquired when spatial decision-making was present at learning, ps < .001, ds > .81. No difference in spatial knowledge was found between active navigation and spatial decision-making by itself, ps > .83, ds < .07. This finding indicates that the weakened spatial knowledge with control alone (guided navigation) can be explained by the absence of spatial decision-making. Experiments 2 and 3 investigated the use of aids for ameliorating the loss of spatial knowledge for guided navigation with auditory directions. In Experiment 2, guided navigation was augmented using visual aids (primarily egocentric) which reinforced the locations of landmarks. In Experiment 3, guided navigation was augmented by adding cardinal directions (e.g. north), which are exocentric, to the auditory guidance, presented either with monaural sound or stereo sound which corresponded to environmental headings. Spatial knowledge in Experiments 2 and 3 was assessed using route replication, novel route execution, and map construction. Contrary to the hypotheses, the aids did not improve all measures of environmental knowledge. Instead, there was a match between the particular reference frame reinforced by the aid and the relevant frame of reference for the measure of spatial knowledge. In Experiment 2, the visual aids improved accuracy for replicating routes, p = .01, d = .75, this measure is egocentric. In Experiment 3, the stereo and monaural cardinal directions improved accuracy for executing a novel route, a directional measure of survey knowledge, ps < .06, ds > .52, which is egocentric and exocentric.

show abstract

Spatial learning and navigation using a virtual verbal display

Cited by 13 publications

References 47 publications

A wearable virtual guide for context-aware cognitive indoor navigation

A wearable virtual guide for context-aware cognitive indoor navigation

Verbalizing, visualizing, and navigating: The effect of strategies on encoding a large-scale virtual environment.

Guided Navigation Impairs Spatial Knowledge: Using Aids to Improve Spatial Representations

Contact Info

Product

Resources

About