An algorithm enabling blind users to find and read barcodes

Abstract

Most camera-based systems for finding and reading barcodes are designed to be used by sighted users (e.g. the Red Laser iPhone app), and assume the user carefully centers the barcode in the image before the barcode is read. Blind individuals could benefit greatly from such systems to identify packaged goods (such as canned goods in a supermarket), but unfortunately in their current form these systems are completely inaccessible because of their reliance on visual feedback from the user. To remedy this problem, we propose a computer vision algorithm that processes several frames of video per second to detect barcodes from a distance of several inches; the algorithm issues directional information with audio feedback (e.g. “left,” “right”) and thereby guides a blind user holding a webcam or other portable camera to locate and home in on a barcode. Once the barcode is detected at sufficiently close range, a barcode reading algorithm previously developed by the authors scans and reads aloud the barcode and the corresponding product information. We demonstrate encouraging experimental results of our proposed system implemented on a desktop computer with a webcam held by a blindfolded user; ultimately the system will be ported to a camera phone for use by visually impaired users.

Autonomous Recognition System for Barcode Detection in Complex Scenes

“…In the presence of a more text intensive area, the performance of these methods will be in poor. Our methods has better robustness and can locate barcodes faster than the method of Refs [7][11].…”

“…At the same time, the accuracy of location using our method is higher than other approaches applied in earlier research. [7] Ref [11] Ours Muenster [11] 90 …”

“…Telkin and Coughlan's method is based on scanning the image in four directions. It was designed mainly for blind people so as to` help them in their routine tasks [7].…”

Implementation of Barcode Localization Technique using Morphological Operations

“…Telkin and Coughlan's method is based on scanning the image in four directions (0°, 90°, 180° and 270°) so as to localize barcodes. It was designed mainly for visually impaired and blind people so as to` help them in their routine tasks [3].…”

Accessible Shopping Systems for Blind and Visually Impaired Individuals: Design Requirements and the State of the Art

“…Definite progress has been made on vision-based barcode recognition algorithms [41]. As the mobile phones become more computationally powerful, these algorithms can successfully be ported to various mobile platforms.…”