Augmenting a window system with speech input

Schmandt, Chris; Ackerman, Mark S.; Hindus, Debby

doi:10.1109/2.56871

Cited by 26 publications

(8 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When used together, combined speech and gesture input can create an interface more powerful that either modality alone. Unlike gesture or mouse input, voice is not tied to a spatial metaphor [14], and so can be used to interact with objects regardless of whether they can be seen or not. However, care must be taken to map the appropriate modality to the application input parameters.…”

Section: Related Workmentioning

confidence: 99%

An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures

Irawati

Green

Billinghurst

et al. 2006

Lecture Notes in Computer Science

View full text Add to dashboard Cite

This paper discusses an evaluation of an augmented reality (AR) multimodal interface that uses combined speech and paddle gestures for interaction with virtual objects in the real world. We briefly describe our AR multimodal interface architecture and multimodal fusion strategies that are based on the combination of time-based and domain semantics. Then, we present the results from a user study comparing using multimodal input to using gesture input alone. The results show that a combination of speech and paddle gestures improves the efficiency of user interaction. Finally, we describe some design recommendations for developing other multimodal AR interfaces.

show abstract

Section: Related Workmentioning

confidence: 99%

An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures

Irawati

Green

Billinghurst

et al. 2006

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

“…More recently Schmandt et al (1990) performed a study of the utility of using speech input to control window navigation in an X Window system while allowing keyboard and mouse input for other tasks, such as interaction with direct manipulation interfaces in application programs. There was no significant difference in speed between speech input and mouse input to navigate between exposed windows, however, speech was superior to the mouse when windows were partially or completely obscured.…”

Section: Studies Conducted Bymentioning

confidence: 99%

Speech versus mouse commands for word processing: an empirical evaluation

Karl

Pettey

Shneiderman

1993

International Journal of Man-Machine Studies

View full text Add to dashboard Cite

Recently the authors conducted an experiment to demonstrate the utility of using speech input for PC-based word processing applications as a supplement to more traditional input devices such as keyboards and mice. In the experiment, speech input was used to execute word processor menu commands, while the keyboard was used for text entry and the mouse for positioning the cursor and selecting text. The authors believe that the results of the experiment provide evidence for the utility of speech input for command activation in PC and office-based applications.

show abstract

“…Audio, both as a data type as well as a component of the user interface, can easily be supported within the the bandwidth and storage capabilities of current networks and magnetic media. Voice should be appearing on every desktop, and some applications, such as voice control of windows (e.g., [12]), can already be found across many platforms.…”

Section: Introductionmentioning

confidence: 99%

Phoneshell

Schmandt¹

1993

Proceedings of the First ACM International Conference on Multimedia - MULTIMEDIA '93

View full text Add to dashboard Cite

This paper describes Phoneshell, a telephone based application providing remote voice access to personal desktop databases such as voice mail, email, calendar, and rolodex. Several forms of information can also be faxed on demand. Phoneshell offers its users numerous opportunities to record voice entries into its underlying databases; this new utility for stored voice as a data type, necessitates multimedia support for the traditional graphical user interfaces to these same databases. The experiences of a small Phoneshell user community are discussed, with emphasis on key features which are most important to its success. The underlying software architecture used by Phoneshell includes a toolkit for building interactive telephone-based services.

show abstract

Augmenting a window system with speech input

Cited by 26 publications

References 8 publications

An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures

An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures

Speech versus mouse commands for word processing: an empirical evaluation

Phoneshell

Contact Info

Product

Resources

About