"Move the couch where?" : developing an augmented reality multimodal interface

Irawati, Sylvia; Green, Scott; Billinghurst, Mark; Duenser, Andreas; Ko, Heedong

doi:10.1109/ismar.2006.297812

Cited by 40 publications

(18 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The user had to wear a data glove and the researchers did not conduct user studies to explore the effectiveness of SenseShapes. Irawati et al [15] has developed a computer vision based multimodal AR system by adding speech input to the VOMAR furniture arranging application [16]. The final system allowed a user to pick and place virtual furniture in an AR scene using a combination of paddle gestures and speech commands.…”

Section: Related Workmentioning

confidence: 99%

A Wizard of Oz study for an AR multimodal interface

Lee

Billinghurst

2008

Proceedings of the 10th International Conference on Multimodal Interfaces

Self Cite

View full text Add to dashboard Cite

In this paper we describe a Wizard of Oz (WOz) user study of an Augmented Reality (AR) interface that uses multimodal input (MMI) with natural hand interaction and speech commands. Our goal is to use a WOz study to help guide the creation of a multimodal AR interface which is most natural to the user. In this study we used three virtual object arranging tasks with two different display types (a head mounted display, and a desktop monitor) to see how users used multimodal commands, and how different AR display conditions affect those commands. The results provided valuable insights into how people naturally interact in a multimodal AR scene assembly task. For example, we discovered the optimal time frame for fusing speech and gesture commands into a single command. We also found that display type did not produce a significant difference in the type of commands used. Using these results, we present design recommendations for multimodal interaction in AR environments.

show abstract

Section: Related Workmentioning

confidence: 99%

A Wizard of Oz study for an AR multimodal interface

Lee

Billinghurst

2008

Proceedings of the 10th International Conference on Multimodal Interfaces

Self Cite

View full text Add to dashboard Cite

show abstract

“…This report is basically based on the application that is to be introduced which will be a mobile application that intends to provide wealthier experiences by overlying words or virtual objects over the scene observed through a camera. The mobile application is a real time visual translator for Bahasa language to English that will be embedded on mobile phones [10]- [12].…”

Section: A Mobile Learningmentioning

confidence: 99%

Ubiquitous Mobile Real Time Visual Translator Using Augmented Reality for Bahasa Language

Parhizkar¹,

Oteng²,

Ndaba³

et al. 2013

IJIET

View full text Add to dashboard Cite

Abstract-Mobile technology have rapidly advanced over the years, successful researches of augmented reality on mobile phones under the different mobile platforms have made it possible to implement augmented reality technology on mobiles. Now the possibility of combining real time visual with augmented reality seems to be a success. This paper is simply to emphasize on combining real time visual with augmented reality technology on mobiles for education purpose. The research is based on how the implementation of real time visual translator on augmented reality mobile applications can help people in understanding/translating and give meanings to some writings displayed around them ubiquitously.

show abstract

“…Their method was robust against partial occlusions of the patterns. Irawati et al [39] showed an extension of Kato's VOMAR interface that fused speech with paddle-based gesture input using time-based and semantic techniques. The overall goal of these new interaction techniques is to enable manipulating AR content to be as easy as interacting with real objects.…”

Section: 21mentioning

confidence: 99%

Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR

Zhou

Duh

Billinghurst

2008

2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality

Self Cite

466

View full text Add to dashboard Cite

Although Augmented Reality technology was first developed over forty years ago, there has been little survey work giving an overview of recent research in the field. This paper reviews the tenyear development of the work presented at the ISMAR conference and its predecessors with a particular focus on tracking, interaction and display research. It provides a roadmap for future augmented reality research which will be of great value to this relatively young field, and also for helping researchers decide which topics should be explored when they are beginning their own studies in the area.

show abstract

"Move the couch where?" : developing an augmented reality multimodal interface

Cited by 40 publications

References 18 publications

A Wizard of Oz study for an AR multimodal interface

A Wizard of Oz study for an AR multimodal interface

Ubiquitous Mobile Real Time Visual Translator Using Augmented Reality for Bahasa Language

Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR

Contact Info

Product

Resources

About