Smart Vision: Assistive Device for the Visually Impaired Community U sing Online Computer Vision Service

Baskaran, Hasventhran; Leng, Rachel Lum Mei; Rahim, Fiza Abdul; Rusli, Mohd Ezanee

doi:10.1109/ccoms.2019.8821635

Cited by 5 publications

(3 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our system processes dense data on an embedded computer, segments the floor, and detects obstacles within 3 m of scope and at 7.56 fps (without displaying data), so it is not necessary to send data to a high-performance computer located in a remote point, unlike [28]. This update rate is sufficient in the context of vision-based navigation aids for blind people, considering the walking speed of a blind person, which in our experiments was in average of 0.17 m/s.…”

Section: Discussionmentioning

confidence: 99%

“…It must be small, light (wearable), and able to process great amount of data at real time, especially when dense data is delivered by sensors like cameras. The authors of [28] use online computer vision service (Microsoft Cognitive Service) for describing images and narrating the scene around the user, based on machine learning and deep learning. It reduces the development cost of this prototype.…”

Section: Related Workmentioning

confidence: 99%

“…The system [25] employs a mobile device with two video cameras and a quad core processor for triggering vibration patterns. Other systems use high-performance embedded processors like a vision processor in [30], the Jetson TX1 in [16], the Jetson TX2 in [31], and the Raspberry Pi in [13,14,28].…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Vision‐Based System for Assisting Blind People to Wander Unknown Environments in a Safe Way

2021

View full text Add to dashboard Cite

Vision is the principal source of information of the surrounding world. It facilitates our movement and development of everyday activities. In this sense, blind people have great difficulty for moving, especially in unknown environments, which reduces their autonomy and puts them at risk of suffering an accident. Electronic Travel Aids (ETAs) have emerged and provided outstanding navigation assistance for blind people. In this work, we present the methodology followed for implementing a stereo vision-based system that assists blind people to wander unknown environments in a safe way, by sensing the world, segmenting the floor in 3D, fusing local 2D grids considering the camera tracking, creating a global occupancy 2D grid, reacting to close obstacles, and generating vibration patterns with an haptic belt. For segmenting the floor in 3D, we evaluate normal vectors and orientation of the camera obtained from depth and inertial data, respectively. Next, we apply RANSAC for computing efficiently the equation of the supporting plane (floor). The local grids are fused, obtaining a global map with data of free and occupied areas along the whole trajectory. For parallel processing of dense data, we leverage the capacity of the Jetson TX2, achieving high performance, low power consumption, and portability. Finally, we present experimental results obtained with ten (10) participants, in different conditions, with obstacles of different height, hanging obstacles, and dynamic obstacles. These results show high performance and acceptance by the participants, highlighting the easiness to follow instructions and the short period of training.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Vision‐Based System for Assisting Blind People to Wander Unknown Environments in a Safe Way

2021

View full text Add to dashboard Cite

show abstract

Recent trends in computer vision-driven scene understanding for VI/blind users: a systematic mapping

Valipoor

Jiménez

2022

Univ Access Inf Soc

View full text Add to dashboard Cite

During the past years, the development of assistive technologies for visually impaired (VI)/blind people has helped address various challenges in their lives by providing services such as obstacle detection, indoor/outdoor navigation, scene description, text reading, facial recognition and so on. This systematic mapping review is mainly focused on the scene understanding aspect (e.g., object recognition and obstacle detection) of assistive solutions. It provides guidance for researchers in this field to understand the advances during the last four and a half years. This is because deep learning techniques together with computer vision have become more powerful and accurate than ever in tasks like object detection. These advancements can bring a radical change in the development of high-quality assistive technologies for VI/blind users. Additionally, an overview of the current challenges and a comparison between different solutions is provided to indicate the pros and cons of existing approaches.

show abstract

Multi-functional Smart E-Glasses for Vision-Based Indoor Navigation

Xia

Liu

et al. 2021

2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM)

View full text Add to dashboard Cite

Smart Vision: Assistive Device for the Visually Impaired Community U sing Online Computer Vision Service

Cited by 5 publications

References 8 publications

Vision‐Based System for Assisting Blind People to Wander Unknown Environments in a Safe Way

Vision‐Based System for Assisting Blind People to Wander Unknown Environments in a Safe Way

Recent trends in computer vision-driven scene understanding for VI/blind users: a systematic mapping

Multi-functional Smart E-Glasses for Vision-Based Indoor Navigation

Contact Info

Product

Resources

About