The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind

Stearns, Lee; Du, Ruofei; Oh, Uran; Wang, Yumeng; Findlater, Leah; Chellappa, Rama; Froehlich, Jon E.

doi:10.1007/978-3-319-16199-0_43

Cited by 13 publications

(12 citation statements)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Differing from these systems, we proposed using the finger as a guide [12], and supporting sequential acquisition of text rather than reading text blocks [19]. This concept has inspired other re searchers in the community [23].…”

Section: Wearable Devicesmentioning

confidence: 99%

“…Year Interface Type of Text Response Time Adaptation Evaluation Reported Accuracy Ezaki et al [4] Mattar et al [11] 1 Pazio et al [14] 2007 Signage Slanted text ICDAR 2003 Yi and Tian [24] 2012 Glasses Signage, Products 1.5s Coloring VI users P 0.68 R 0.54 Shen and Coughlan [18] Kane et al [7] 2012 2013 PDA, Tactile Stationery Signage Printed page <1s Interactive VI users Warping VI users Stearns et al [23] 2014 Finger-worn Printed page Interactive Warping VI users Shilkrot et al [19] 2014 Finger-worn Printed page Interactive Slanting, Lighting VI users 1 This report is of the OCR / text extraction engine alone and not the complete system. Table 1: Recent efforts in academia of text-reading solutions for the VI.…”

Section: Publicationmentioning

confidence: 99%

“…Meijer's vOICe for Android project is an algorithm that translates a scene to sound; re cently they introduced OCR capabilities and enabling usage of Google Glass 8 . ABiSee's EyePal ROL is a portable read ing device, albeit quite large and heavy 9 , to which OrCam's Prototypes and products in all three categories, save for [23], follow the assumption that the goal is to consume an entire block of text at once, therefore requiring to image the text from a distance or use a special stand. In contrast, we fo cused on creating a smaller and less conspicuous device, al lowing for intimate operation with the finger that will not seem strange to an outside onlooker, following the conclu sions of Shinohara and Wobbrock [21].…”

Section: Assistive Mobile Text Reading Productsmentioning

confidence: 99%

See 2 more Smart Citations

FingerReader

Shilkrot

Huber

et al. 2015

Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Accessing printed text in a mobile context is a major challenge for the blind. A preliminary study with blind people reveals numerous difficulties with existing state-of-the-art technologies including problems with alignment, focus, accuracy, mobility and efficiency. In this paper, we present a finger-worn device, FingerReader, that assists blind users with reading printed text on the go. We introduce a novel computer vision algorithm for local-sequential text scanning that enables reading single lines, blocks of text or skimming the text with complementary, multimodal feedback. This system is implemented in a small finger-worn form factor, that enables a more manageable eyes-free operation with trivial setup. We offer findings from three studies performed to determine the usability of the FingerReader.

show abstract

Section: Wearable Devicesmentioning

confidence: 99%

Section: Publicationmentioning

confidence: 99%

Section: Assistive Mobile Text Reading Productsmentioning

confidence: 99%

See 1 more Smart Citation

FingerReader

Shilkrot

Huber

et al. 2015

Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…Shinohara and Wobbrock have pointed out that assistive technology can impede social interaction [43] and introduced the term social accessibility to prompt designers to think beyond the assistance a device provides to its practicality in a social setting [42]. Zolyomi et al take this one step further to consider the social dimensions of adopting a particular sight assistive technology [57].…”

Section: Systems Research For People With Visual Disabilitiesmentioning

confidence: 99%

Imagining Artificial Intelligence Applications with People with Visual Disabilities using Tactile Ideation

Morrison

Cutrell

Dhareshwar

et al. 2017

Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

View full text Add to dashboard Cite

This is the accepted version of the paper.This version of the publication may differ from the final published version. Permanent repository link ABSTRACTThere has been a surge in artificial intelligence (AI) technologies co-opted by or designed for people with visual disabilities. Researchers and engineers have pushed technical boundaries in areas such as computer vision, natural language processing, location inference, and wearable computing. But what do people with visual disabilities imagine as their own technological future? To explore this question, we developed and carried out tactile ideation workshops with participants in the UK and India. Our participants generated a large and diverse set of ideas, most focusing on ways to meet needs related to social interaction. In some cases, this was a matter of recognizing people. In other cases, they wanted to be able to participate in social situations with their disability being unobtrusive. It was striking that this finding was consistent across UK and India despite substantial cultural and infrastructural differences. In this paper, we describe a new technique for working with people with visual disabilities to imagine new technologies that are tuned to their needs and aspirations. Based on our experience with these workshops, we provide a set of social dimensions whereby users' social needs and desires are a more deliberate consideration for assistive technology design.

show abstract

“…Shilkrot et al [Shilkrot et al 2015] and, in separate work, Stearns et al [Stearns et al 2014], designed a finger-mounted camera that could be used to scan a text line. OrCam 4 is a wearable camera with a dedicated embedded computer that enables users to trigger OCR reading by pointing at the text with their index finger.…”

Section: Related Workmentioning

confidence: 99%

Improving the Accessibility of Mobile OCR Apps Via Interactive Modalities

Cutter

Manduchi

2017

ACM Trans. Access. Comput.

View full text Add to dashboard Cite

Mobile optical character recognition (OCR) apps have come of age. Many blind individuals use them on a daily basis. The usability of such tools, however, is limited by the requirement that a good picture of the text to be read must be taken, something that is difficult to do without sight. Some mobile OCR apps already implement auto-shot and guidance mechanisms to facilitate this task. In this paper, we describe two experiments with blind participants, who tested these two interactive mechanisms on a customized iPhone implementation. These experiments bring to light a number of interesting aspects of accessing a printed document without sight, and enable a comparative analysis of the available interaction modalities.

show abstract

The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind

Cited by 13 publications

References 40 publications

FingerReader

FingerReader

Imagining Artificial Intelligence Applications with People with Visual Disabilities using Tactile Ideation

Improving the Accessibility of Mobile OCR Apps Via Interactive Modalities

Contact Info

Product

Resources

About