Blind and visually impaired people cannot accurately judge the changes in their surroundings due to eyesight limitations, which increases the risk of accidents indoors and outdoors. We propose mobile ARML based on Mobile-Net Single-shot Detection (MobileNet-SSD), Augmented Reality (AR), and a Voice Interaction system for object detection and distance calculation. ARML aimed to (i) aid visually impaired people to avoid obstacles in daily life and (ii) quickly query the user-specified items utilizing computer vision; (iii) Integrates Lidar for both AR/VR experiences reducing additional equipment and improving detection accuracy of distance between users and obstacles. This system safely improves their ability to identify obstacles in their environment and improves the quality of life for visually impaired people. Experimental results indicate distance accuracy of 96% within the five-meter range, outpacing other research (Chen et al., 2019) and FPS more than forty-four frames per second, surpassing similar projects (Srinivasan et al., 2020).
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.