Android based application for visually impaired using deep learning approach

Abstract

<span>People with visually impaired had difficulties in doing activities related to environment, social and technology. Furthermore, they are having issues with independent and safe in their daily routine. This research propose deep learning based visual object recognition model to help the visually impaired people in their daily basis using the android application platform. This research is mainly focused on the recognition of the money, cloth and other basic things to make their life easier. The convolution neural network (CNN) based visual recognition model by TensorFlow object application programming interface (API) that used single shot detector (SSD) with a pre-trained model from Mobile V2 is developed at Google dataset. Visually impaired persons capture the image and will be compared with the preloaded image dataset for dataset recognition. The verbal message with the name of the image will let the blind used know the captured image. The object recognition achieved high accuracy and can be used without using internet connection. The visually impaired specifically are largely benefited by this research.</span>

Comparative study of teachable machine for forest fire and smoke detection by drone

“…Obtaining datasets that are both large and diverse is a frequent obstacle in DL [19]. Images serve as a prime illustration of this kind of dataset.…”

Image captioning to aid blind and visually impaired outdoor navigation

“…The device can identify faces, recognize familiar objects, and read text on images. Meanwhile, Nasir et al [68] developed an android-based object recognition model that can aid the blind in recognizing ordinary objects they encounter every day, such as money, clothing, and other items. In 2021, research [69] combined the deep learning image classification architecture VGG-16 with the RNN algorithm to develop an image captioning model for the visually impaired using the flickr8k dataset.…”