NEIMO, a multiworkstation usability lab for observing and analyzing multimodal interaction

Coutaz, Joëlle; Salber, Daniel; Carraux, Eric; Portolan, N.

doi:10.1145/257089.257904

Cited by 21 publications

(8 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Salber and Coutaz [20] provide a good overview of how WOz techniques can be applied to a multimodal interface. Their NEIMO system [21] uses these methods in a multimodal usability lab, although they have not explored AR and VR systems. There are many examples of how WOz techniques can be used for system prototyping in various research areas.…”

Section: Related Workmentioning

confidence: 99%

A Wizard of Oz study for an AR multimodal interface

Lee

Billinghurst

2008

Proceedings of the 10th International Conference on Multimodal Interfaces

View full text Add to dashboard Cite

In this paper we describe a Wizard of Oz (WOz) user study of an Augmented Reality (AR) interface that uses multimodal input (MMI) with natural hand interaction and speech commands. Our goal is to use a WOz study to help guide the creation of a multimodal AR interface which is most natural to the user. In this study we used three virtual object arranging tasks with two different display types (a head mounted display, and a desktop monitor) to see how users used multimodal commands, and how different AR display conditions affect those commands. The results provided valuable insights into how people naturally interact in a multimodal AR scene assembly task. For example, we discovered the optimal time frame for fusing speech and gesture commands into a single command. We also found that display type did not produce a significant difference in the type of commands used. Using these results, we present design recommendations for multimodal interaction in AR environments.

show abstract

Section: Related Workmentioning

confidence: 99%

A Wizard of Oz study for an AR multimodal interface

Lee

Billinghurst

2008

Proceedings of the 10th International Conference on Multimodal Interfaces

View full text Add to dashboard Cite

show abstract

“…For example one wizard can simulate a device (e.g., a touch sensitive table) or a modality (e.g., speech recognition) or the combination of modalities. Our approach is inspired by NEIMO [5], a platform with any number of wizards, each wizard being dedicated to a particular modality. By distributing elementary roles to wizards, our goal is to reduce the task load of the wizard by reducing the complexity, since it can be really challenging for a single wizard to keep track of a complete flexible multimodal application.…”

Section: Related Workmentioning

confidence: 99%

A wizard of oz component-based approach for rapidly prototyping and testing input multimodal interfaces

Serrano

Nigay

2010

J Multimodal User Interfaces

View full text Add to dashboard Cite

In this paper we present a novel approach for prototyping, testing and evaluating multimodal interfaces, OpenWizard. OpenWizard allows the designer and the developer to rapidly evaluate a non-fully functional multimodal prototype by replacing one modality or a composition of modalities that are not yet available by wizard of oz techniques. OpenWizard is based on a conceptual componentbased approach for rapidly developing multimodal interfaces, an approach first implemented in the ICARE software tool and more recently in the OpenInterface tool. We present a set of wizard of oz components that are implemented in OpenInterface. While some wizard of oz (WoZ) components are generic to be reused for different multimodal applications, our approach allows the integration of tailored WoZ components. We illustrate OpenWizard using a multimodal map navigator.

show abstract

“…It automatically instruments the source code with a monitor that detects deviation from the expected work-flow [7]. Most previous approaches needed such instrumentation to be carried out manually [11], which is error-prone in itself. This is something that many previous projects have had in common.…”

Section: Related Workmentioning

confidence: 99%

A Preliminary Experiment of Checking Usability Principles with Formal Methods

Kristoffersen

2009

2009 Second International Conferences on Advances in Computer-Human Interactions

View full text Add to dashboard Cite

Theoretical computer science has been occupied with formal methods since the beginning. It has had its share of challenges, though. Often, excessive additional work is required to re-specify applications precisely in a new formalism, so that they can be analyzed algorithmically. With more model-based software engineering, this may have changed. In many instances, specifications are now complete and updated throughout the systems development life-cycle, primarily to drive rather than to document the process. Thus, formal approaches have become more realistic. This paper looks at one experiment with automatic usability evaluation, based on a structured user interface specification. It shows that there are promising results ahead. Examples of automatic usability evaluation based on a widely-use userinterface specification language are presented. Benefits of formal specification cannot be reaped,however, unless this approach is bolstered by a purposeful design of the modeling techniques and languages themselves. Thus, some requirements of the formalisms for model-based usability engineering conclude the paper.

show abstract

NEIMO, a multiworkstation usability lab for observing and analyzing multimodal interaction

Cited by 21 publications

References 3 publications

A Wizard of Oz study for an AR multimodal interface

A Wizard of Oz study for an AR multimodal interface

A wizard of oz component-based approach for rapidly prototyping and testing input multimodal interfaces

A Preliminary Experiment of Checking Usability Principles with Formal Methods

Contact Info

Product

Resources

About