Software and hardware solutions for Using the keyboards by blind people

Oproescu, Mihai; Iana, Gabriel-Vasile; Bizon, Nicu; Novac, Ovidiu Constantin; Novac, Mihaela Cornelia

doi:10.1109/emes.2019.8795191

Cited by 8 publications

(2 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Later, Al-Quadah et al improved the device on this basis, using the law of vibration of the cell phone and the Morse code to encode Braille, which made the application of Braille reading by phone wider [23], but the recognition accuracy of Braille is low, only 71%. In addition, in the category of direct-contact devices, there has been a lot of research on vibrotactile keyboards in recent years [24][25][26], and most of the keyboard devices are used in conjunction with Braille displays to realize human-to-human communication. For example, Aqel [27] designed an electronic Braille reading and writing device that uses six vibrotactile actuators (a.k.a.…”

Section: Introductionmentioning

confidence: 99%

Design and Implementation of a Semantic Information Expression Device Based on Vibrotactile Coding

Shao,

Mei,

et al. 2023

Applied Sciences

View full text Add to dashboard Cite

In recent years, research on new technologies for expressing and exchanging information through tactile vibration has been the focus of researches. In this paper, by choosing a suitable coding scheme and a vibrating motor arrangement, we designed a device to express semantic information through vibrotactile. Three types of experiments were designed to test the usability of the encoding scheme and the device. Firstly, the vibration intensity was experimented when designing the encoding scheme, and the results showed that the encoding scheme was better with Braille units of 0.2 and 0.3 vibration intensities. In addition, the learning experiment and sentence recognition accuracy experiment were carried out to verify the usability of the device. The learning experiment results show that subjects were able to memorize Braille characters with an accuracy more than 90%, and to recognize a Chinese character (consisting of two Braille cells) with an average of 90.8% accuracy. The sentence recognition accuracy test experiment results show that the average recognition rate of the three poems used for the test was 93.33%. The device can be used for semantic information expression and touch-reading of Braille, and it can realize the reading experience of paper Braille.

show abstract

Section: Introductionmentioning

confidence: 99%

Design and Implementation of a Semantic Information Expression Device Based on Vibrotactile Coding

Shao,

Mei,

et al. 2023

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Trying to adapt, to a greater or lesser extent, to the world is a constant challenge. Many works have addressed the environment understanding [5,6] and the urban navigation problem [7,8], by developing assistive devices based on smart sensors or artificial vision [9]; some others have proposed solutions for reading [10,11] and computer access [12,13] by exploiting the same devices and technologies. However, few works have focused on assisting visually impaired (VI) people in finding daily used objects.…”

Section: Introductionmentioning

confidence: 99%

Solar-Powered Deep Learning-Based Recognition System of Daily Used Objects and Human Faces for Assistance of the Visually Impaired

et al. 2020

View full text Add to dashboard Cite

This paper introduces a novel low-cost solar-powered wearable assistive technology (AT) device, whose aim is to provide continuous, real-time object recognition to ease the finding of the objects for visually impaired (VI) people in daily life. The system consists of three major components: a miniature low-cost camera, a system on module (SoM) computing unit, and an ultrasonic sensor. The first is worn on the user’s eyeglasses and acquires real-time video of the nearby space. The second is worn as a belt and runs deep learning-based methods and spatial algorithms which process the video coming from the camera performing objects’ detection and recognition. The third assists on positioning the objects found in the surrounding space. The developed device provides audible descriptive sentences as feedback to the user involving the objects recognized and their position referenced to the user gaze. After a proper power consumption analysis, a wearable solar harvesting system, integrated with the developed AT device, has been designed and tested to extend the energy autonomy in the different operating modes and scenarios. Experimental results obtained with the developed low-cost AT device have demonstrated an accurate and reliable real-time object identification with an 86% correct recognition rate and 215 ms average time interval (in case of high-speed SoM operating mode) for the image processing. The proposed system is capable of recognizing the 91 objects offered by the Microsoft Common Objects in Context (COCO) dataset plus several custom objects and human faces. In addition, a simple and scalable methodology for using image datasets and training of Convolutional Neural Networks (CNNs) is introduced to add objects to the system and increase its repertory. It is also demonstrated that comprehensive trainings involving 100 images per targeted object achieve 89% recognition rates, while fast trainings with only 12 images achieve acceptable recognition rates of 55%.

show abstract

LECTO: A Smart Assistant for People with Visual Impairment for Reading Texts in Spanish

Ortega

Quevedo

Guevara

et al. 2022

Emerging Research in Intelligent Systems

View full text Add to dashboard Cite

Software and hardware solutions for Using the keyboards by blind people

Cited by 8 publications

References 8 publications

Design and Implementation of a Semantic Information Expression Device Based on Vibrotactile Coding

Design and Implementation of a Semantic Information Expression Device Based on Vibrotactile Coding

Solar-Powered Deep Learning-Based Recognition System of Daily Used Objects and Human Faces for Assistance of the Visually Impaired

LECTO: A Smart Assistant for People with Visual Impairment for Reading Texts in Spanish

Contact Info

Product

Resources

About