A New Architecture based AR for Detection and Recognition of Objects and Text to Enhance Navigation of Visually Impaired People

Ouali, Imene; Sassi, Mohamed Saifeddine Hadj; Halima, Mohamed Ben; Wali, Ali

doi:10.1016/j.procs.2020.08.062

Cited by 18 publications

(6 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Finally, Imene et al [30] proposed an AR-based architecture to identify and recognize Arabic letters with diacritics in real-time, and to read the detected Arabic words with diacritical marks via AR as a 2D image. Imene et al [32] introduced an architecture for text and object recognition using augmented reality (AR). The authors developed the detection module and AR engines for text and object recognition.…”

Section: Ar-based Methods For Text Visualizationmentioning

confidence: 99%

Augmented Reality and Ontology-based Approach for Enhancing Arabic Text Recognition and Visualization

Ouali

Halima

MASMOUDI

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

Written text is a commonly used means of transferring information in our daily lives, and it is especially crucial in unfamiliar environments where we rely on written text to achieve our goals. In such scenarios, signs or signboards help us navigate and determine the direction we should take. However, various factors, such as prolonged exposure to the text, text obstructions, and poor lighting, may hinder our ability to read the text accurately, leading to erroneous readings. A single incorrectly read letter can lead to a false interpretation of the entire text, potentially resulting in serious consequences. To address this issue, we propose an approach to correct letter imperfections in a word and display it in an improved manner. Our approach consists of two phases: the pre-treatment phase and the letter imperfection recovery phase. The pre-treatment phase relies on Augmented Reality technology to detect and recognize text with letter imperfections. In the letter imperfection recovery phase, we employ ontology and a database to correct the letter imperfections. To enhance the accuracy of our results, we apply Augmented Reality technology to obtain a 3D image for perfect visualization. We conducted an evaluation and experimentation phase by administering a questionnaire to a group of participants to obtain feedback on our approach. The results were encouraging and demonstrated the effectiveness of our approach.

show abstract

Section: Ar-based Methods For Text Visualizationmentioning

confidence: 99%

Augmented Reality and Ontology-based Approach for Enhancing Arabic Text Recognition and Visualization

Ouali

Halima

MASMOUDI

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…As the number of people with visual disabilities increases, many systems for the blind is being developed. The braille block system using camera-based mobility aid and detection of immovable objects and gait-assistance system which combines RFID and braille block are examples of systems being developed [22][23][24][25][26]. The Braille block system uses image processing to collect images by attaching a Raspberry Pi camera to a white cane which then recognizes a braille block to inform the user with a vibrating motor.…”

Section: A Visual Cognitive Assistive Systemmentioning

confidence: 99%

An Application on Visual Cognitive Assistance system for Braille Block Recognition Based on Raspberry Pi System

Kim¹,

Lee²,

Son³

et al. 2021

International Journal on Advanced Science, Engineering and Information Technology

View full text Add to dashboard Cite

There are many visually impaired people living their lives throughout the world. As of now, the only realistic tools available for these people are white sticks and guide dogs. However, these visual aids are insufficient for handling unexpected obstacles in various environments. Accidents tend to occur frequently, and these aids are very costly, thus limiting their usefulness for the visually impaired. This paper aims to develop a visual aid cognitive system and explores the possibility of practical performance. The overall system configuration uses the Raspberry Pi and OpenCV in real-time to capture braille block images and recognize the braille blocks' pattern. It also gathers information about the surrounding environment before conveying the information to the user. In the first phase, the Go/Stop signal is determined by the linear or circular braille block according to the type of braille block. In the second phase, the visual aid system equipped with an ultrasonic sensor warns the user when encountering an obstacle so that the user can walk safely. We implemented a text recognition system based on a Text-to-Speech converter that transmits the text recognition information to the visually impaired and tested TTS function to read various street signs with various fonts. We lastly discuss the future possibility for our auxiliary system in various road environments and how it can be improved to help visually impaired people.

show abstract

“…Augmented Reality (AR) is a method to engage with an actual world environment in which computer-generated perceptual information is used to augment the objects in the actual world, typically throughout different sensory modalities such as visual, aural, haptic, somatosensory, and olfactory [1]. AR is a system or application that integrates actual and virtual worlds, allows for real-time interaction, and allows for accurate 3-dimension registration of virtual and actual objects [2]. The AR sensory data can be either constructive or deductive which means the AR sensory data is either additive to the natural environment or masking the natural environment [3].…”

Section: Introductionmentioning

confidence: 99%

Heuristic Evaluation on Affective 4-Dimensional Augmented Reality Mathematics for Children with Low Vision

Aziz¹,

Ahmad²,

Binsaleh³

et al. 2023

IJIET

View full text Add to dashboard Cite

Low-vision children need engaging technology to explore learning materials regardless of visual impairment, which usually restricts their access to innovative learning tools. Understanding and learning fractions in Mathematics could be challenging for them as it requires conceptualization and visualization of the divisional concept. Having considered their ability to visualize the learning content, this study introduced a mobile 4-Dimensional Augmented Reality with the inclusion of affective attributes, which are feeling, thought, emotion, and action, known as Affective 4-Dimensional Augmented Reality Mathematics for Low Vision (ARM4LV). Before the apps are introduced to the targeted users, this study conducts a heuristic evaluation to extract comments and suggestions from the perspective of experts and validate the prototype. The heuristic evaluation is based on Nielsen and Molich’s 10 Heuristics with nine principles and engaged with six experts. They were involved in two phases of evaluation sessions. Results revealed that all experts strongly agreed that the prototype is usable and applicable to low vision needs with the overall mean score being 4.7. However, it still requires some improvement and enhancement in terms of user control expectations which will be further explored in the future.

show abstract

A New Architecture based AR for Detection and Recognition of Objects and Text to Enhance Navigation of Visually Impaired People

Cited by 18 publications

References 17 publications

Augmented Reality and Ontology-based Approach for Enhancing Arabic Text Recognition and Visualization

Augmented Reality and Ontology-based Approach for Enhancing Arabic Text Recognition and Visualization

An Application on Visual Cognitive Assistance system for Braille Block Recognition Based on Raspberry Pi System

Heuristic Evaluation on Affective 4-Dimensional Augmented Reality Mathematics for Children with Low Vision

Contact Info

Product

Resources

About