ARGUS Autonomous Navigation System for People with Visual Impairments

Carrasco, Eduardo; Loyo, Estíbaliz; Otaegui, Oihana; Fösleitner, Claudia; Dubielzig, Markus; Olmedo, Rafael; Wasserburger, Wolfgang; Spiller, John

doi:10.1007/978-3-319-08599-9_16

Cited by 5 publications

(2 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Thirdly, in addition to SSD, several systems used virtual sound sources to intuitively guide users along a route, e.g., [ 34 , 35 ]. As appreciated in PVAS implementation and the corresponding user tests, these acoustic cues are supported by VES; in fact, these were the only cues available to reach the three columns in the first VES navigation experiment ( Figure 10 and Figure 11 b).…”

Section: Discussionmentioning

confidence: 99%

VES: A Mixed-Reality Development Platform of Navigation Systems for Blind and Visually Impaired

Real

Araújo

2021

Sensors

View full text Add to dashboard Cite

Herein, we describe the Virtually Enhanced Senses (VES) system, a novel and highly configurable wireless sensor-actuator network conceived as a development and test-bench platform of navigation systems adapted for blind and visually impaired people. It allows to immerse its users into “walkable” purely virtual or mixed environments with simulated sensors and validate navigation system designs prior to prototype development. The haptic, acoustic, and proprioceptive feedback supports state-of-art sensory substitution devices (SSD). In this regard, three SSD were integrated in VES as examples, including the well-known “The vOICe”. Additionally, the data throughput, latency and packet loss of the wireless communication can be controlled to observe its impact in the provided spatial knowledge and resulting mobility and orientation performance. Finally, the system has been validated by testing a combination of two previous visual-acoustic and visual-haptic sensory substitution schemas with 23 normal-sighted subjects. The recorded data includes the output of a “gaze-tracking” utility adapted for SSD.

show abstract

Section: Discussionmentioning

confidence: 99%

VES: A Mixed-Reality Development Platform of Navigation Systems for Blind and Visually Impaired

Real

Araújo

2021

Sensors

View full text Add to dashboard Cite

show abstract

“…Other interfaces incorporated non-linguistic solutions, ranging from spatialized audio to haptic displays. For instance, Head-Related Transfer Function (HRTF) sound processing and motion capture systems were applied to guide BVI users along a route by reproducing virtual sound sources at intermediate points [9]. Also, hand-held devices were developed which provided verbal messages according to the position pointed at, or tapped, on a map [10,11]; others change shape to provide heading cues [12].…”

Section: Related Workmentioning

confidence: 99%

VES: A Mixed-Reality System to Assist Multisensory Spatial Perception and Cognition for Blind and Visually Impaired People

Real

Araújo

2020

Applied Sciences

View full text Add to dashboard Cite

In this paper, the Virtually Enhanced Senses (VES) System is described. It is an ARCore-based, mixed-reality system meant to assist blind and visually impaired people’s navigation. VES operates in indoor and outdoor environments without any previous in-situ installation. It provides users with specific, runtime-configurable stimuli according to their pose, i.e., position and orientation, and the information of the environment recorded in a virtual replica. It implements three output data modalities: Wall-tracking assistance, acoustic compass, and a novel sensory substitution algorithm, Geometry-based Virtual Acoustic Space (GbVAS). The multimodal output of this algorithm takes advantage of natural human perception encoding of spatial data. Preliminary experiments of GbVAS have been conducted with sixteen subjects in three different scenarios, demonstrating basic orientation and mobility skills after six minutes training.

show abstract