Blind Reader: An Object Identification Mobile- based Application for the Blind using Augmented Reality Detection

Mambu, Joe Yuan; Anderson, Elisa; Wahyudi, Andria Kusuma; Keyeh, Gerent; Dajoh, Billy

doi:10.1109/icoris.2019.8874906

Cited by 17 publications

(7 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The utilization of AR technology in enhancing the daily experiences of individuals, particularly those with visual impairments, presents a significant paradigm shift in the perceptions and interactions with our surroundings [11]. AR's potential has been extensively demonstrated through its application in various domains such as navigation systems [11], text and image readers [12], and object detection mechanisms [13]. These advancements have showcased AR's capacity to seamlessly integrate digital information into the physical world, thereby offering enriched, accessible experiences to users with visual impairments.…”

Section: Related Workmentioning

confidence: 99%

Beyond Sight: Enhancing Augmented Reality Interactivity with Audio-Based and Non-Visual Interfaces

2024

Applied Sciences

View full text Add to dashboard Cite

Augmented Reality (AR) is rapidly advancing, with a new focus on broadening accessibility beyond the visually dominant interfaces. This study explores the integration of audio-based non-visual interfaces within AR, aiming to cater to a diverse audience, including users with visual impairments. The objective was to develop a prototype that leverages audio feedback to facilitate interaction with the AR environment, enhancing spatial awareness and mental imagery for all users without relying on visual cues. Employing a user-centered design approach, we conducted a comprehensive evaluation with university students to assess the prototype’s usability and immersive potential compared to traditional touchscreen interfaces. The findings highlighted a pronounced preference for the Audio-Based Natural Interface, emphasizing its capacity to provide an intuitive and immersive AR experience through sound alone. These results underline the potential of audio feedback in creating more inclusive AR experiences, suggesting a paradigm shift towards developing AR technologies that are accessible to a wider user base. Our study concludes that audio-based non-visual interfaces represent a viable and innovative direction for AR development, advocating for their further exploration to ensure AR’s universality and inclusivity.

show abstract

Section: Related Workmentioning

confidence: 99%

Beyond Sight: Enhancing Augmented Reality Interactivity with Audio-Based and Non-Visual Interfaces

2024

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…To overlay the objects and produces the sound of the item name. Helping the daze individuals recognize an object (Mambu et al, 2019) Augmented video, animation, and sound…”

Section: Ar Learning Environmentmentioning

confidence: 99%

A Review on 3D Augmented Reality Design Technique and Inward Leakage Testing on Protective Face Mask

Kamaluddin¹,

Kassim²,

Shahbudin³

2022

JST

View full text Add to dashboard Cite

Protective face mask identification is essential today to users as it is a prominent protective wearable to shield from being infected by Covid-19 viruses. Protective face masks consist of layers of fibers that can capture large respiratory droplets and microscopic particles such as viruses or dust. Thus, mask filtration efficiency results depend on the materials used for each layer. Detail about mask description and efficiency are still anonymous to users, which is vital in this COVID-19. Therefore, this paper reviews designing 3D augmented reality for the protective mask with its detail parameter and mask sizing recommendation on android mobile. About 73 articles on the protective face mask, 3D augmented reality modeling, masks inward leakage testing, breathing resistance, and measuring faces have been reviewed. The result examines the existing protective face mask, inward leakage testing parameter, breathing resistance parameters, 3D modeling techniques, mobile applications, and the application used for measuring faces. The identified result shows six recent and familiar masks with 8% of arithmetic mean for inward leakage testing. The best flow efficiency is determined a 0.3 Microns bigger than 95%. The result also shows a detailed parameter for inward leakage testing in terms of inhalation resistance and flow rate. The comparison for 3D AR parameters is identified for application type, evaluated parameter, technical support parameter, AR platform, and software. This research is significant for developing AR mobile applications that ease and transparency information to the community for safety and health issues in Malaysia.

show abstract

“…The operation and usage of object detection applications for the blind have been described by Mambu et al (19) who describe the steps a blind user takes to use the application. It involves opening the application using Google Assistant, getting auditory feedback once the application is open, pointing the camera to the object to be detected, and getting the output after recognition.…”

Section: Ecs Transactions 107 (1) 11781-11790 (2022)mentioning

confidence: 99%

Banknote Denomination Recognition on Mobile Devices

Sohan¹,

Akanksh²,

Anala³

et al. 2022

ECS Trans.

View full text Add to dashboard Cite

Several mobile applications have been developed to facilitate denomination detection for blind users. However, none of the existing applications allow for detecting multiple notes in a single frame and relaying the total denomination, nor is there a dataset available for the new Indian currency notes, annotated for object detection training. We describe the development of a detection application that aims to improve on the previously existing solutions by enabling multi-note detection, continuous audio feedback, automatic torch usage, and minimal user-application interaction. YOLOv4 allowed the training of a lightweight and fast object detection model with high accuracy on a custom-created dataset post-demonetization of Indian currencies that is deployed on a mobile device.

show abstract

Blind Reader: An Object Identification Mobile- based Application for the Blind using Augmented Reality Detection

Cited by 17 publications

References 4 publications

Beyond Sight: Enhancing Augmented Reality Interactivity with Audio-Based and Non-Visual Interfaces

Beyond Sight: Enhancing Augmented Reality Interactivity with Audio-Based and Non-Visual Interfaces

A Review on 3D Augmented Reality Design Technique and Inward Leakage Testing on Protective Face Mask

Banknote Denomination Recognition on Mobile Devices

Contact Info

Product

Resources

About