The Development and Evaluation of an Eyes-Free Interaction Model for Mobile Reading Devices

Abstract

Research into eyes-free mobile reading devices has grown in recent years. This research has focused mainly on the image processing required by such a device, with a lower emphasis on the user interaction. In this paper, a model of a voice user interface (VUI) for a mobile reading device is presented. Three field studies with blind participants were conducted to develop and refine the model. A formal grammar is used to describe the VUI, and a stochastic Petri net was developed to model the complete user-device interaction. Evaluation and analysis of the user testing of a prototype led to empirically derived probabilities of grammar token usage for the commands that comprise the VUI Index Terms-Audio user interfaces, human computer interaction, human factors, interactive systems, modeling, speech recognition, stochastic systems, user interaces.

Converting Natural Language Text Sentences Into SPN Representations for Associating Events

“…It can also serve as a testbed for integration and synchronization of other single modalities, such as speech, NL translation, by representing structural and functional knowledge in the same SPN model, and it is an e±cient synchronization scheme for multimodal sources. Finally, an important application of such a methodology-tool could be its use as an intelligent assistant to visually impaired individuals [26].…”

“…The SPN model is based on a formal 9-tuple [10,26]. Since the SPN model is widely known, its de¯nition here is omitted.…”

Low Cost Visual Support System for Challenged People

“…A visual navigation system based on a USB camera has been considered, as has a system that detects obstacles using ultrasonic sensors. Both of these systems have been considered [11]. An audible beep is used to notify the user of obstacles that are up to 300 centimeters away from them in the proposed system.…”

Editorial IEEE Transactions on Human–Machine Systems: Year in Review for 2013

“…With respect to support for the sight-impaired, Keefer et al [25] describe the development of a stochastic Petri net (SPN) [26] for use in the development of a voice user interface (VUI) of a mobile reading device for the blind. A decision ladder [27]- [29] was used to describe the interaction.…”