An ARCore Based User Centric Assistive Navigation System for Visually Impaired People

Abstract

In this work, we propose an assistive navigation system for visually impaired people (ANSVIP) that takes advantage of ARCore to acquire robust computer vision-based localization. To complete the system, we propose adaptive artificial potential field (AAPF) path planning that considers both efficiency and safety. We also propose a dual-channel human–machine interaction mechanism, which delivers accurate and continuous directional micro-instruction via a haptic interface and macro-long-term planning and situational awareness via audio. Our system user-centrically incorporates haptic interfaces to provide fluent and continuous guidance superior to the conventional turn-by-turn audio-guiding method; moreover, the continuous guidance makes the path under complete control in avoiding obstacles and risky places. The system prototype is implemented with full functionality. Unit tests and simulations are conducted to evaluate the localization, path planning, and human–machine interactions, and the results show that the proposed solutions are superior to those of the present state-of-the-art solutions. Finally, integrated tests are carried out with low-vision and blind subjects to verify the proposed system.

VES: A Mixed-Reality System to Assist Multisensory Spatial Perception and Cognition for Blind and Visually Impaired People

“…Simultaneous Locating and Mapping technology (SLAM) from Google Tango eased the development of interfaces for BVI people's navigation, which required no additional infrastructure installation [25,26]. This can be also applied to systems such as Google ARCore [27], which capture the motion of compatible smartphones through Concurrent Odometry and Mapping technology (COM).…”

A Hybrid Marker-Based Indoor Positioning System for Pedestrian Tracking in Subway Stations

“…Navigation services for people with visual impairments have also been studied [18,19]. In [18], adaptive artificial potential field (AAPF) path planning was proposed to enable more efficient and safer path planning.…”

“…Navigation services for people with visual impairments have also been studied [18,19]. In [18], adaptive artificial potential field (AAPF) path planning was proposed to enable more efficient and safer path planning. In addition, haptic gloves were used to communicate between the user and the smartphone to provide stable guidance-while the left glove guided the road, and the right glove informed obstacles.…”

Object Identification and Safe Route Recommendation Based on Human Flow for the Visually Impaired

“…The pose (position and direction) of the device that moves with the pedestrian can be estimated from the data obtained from these sensors. An indoor localization system (ANSVIP) was developed using ARCore-compatible smartphones [11]. The PERCEPT-V was developed by integrating a background extraction module based on robust principle component analysis (RPCA) into the localization algorithm.…”