Output multimodal interaction involves choice and combination of relevant interaction modalities to present information to the user. In this paper, we present a framework based on reusable software components for rapidly developing output multimodal interfaces by choosing and combining interaction modalities. Such an approach enables us to quickly explore several design alternatives as part of an iterative design process. Our approach is illustrated by examples from a computer-assisted surgery system that runs in a specific environment (i.e. an operating room) and so needs adapted multimodal interaction. Our approach supports the exploration of several output multimodal interaction design alternatives with the surgeons.

RESUMECet article propose une approche pluridisciplinaire de la modélisation du domaine des systèmes mixtes, une telle modélisation, nécessaire pour structurer le domaine récent des systèmes mixtes et pour faciliter la conception et l'évaluation du point de vue génie logiciel et ergonomique, est basée sur la combinaison de deux approches : la notation ASUR et un modèle basé sur des recommandations ergonomiques. Les deux approches sont décrites, ainsi que le résultat de leur combinaison. Le modèle proposé, une extension de la notation ASUR, est présenté ainsi que ses limites et perspectives. ABSTRACTThis paper describes a multidisciplinary approach to the modelling of the mixed reality systems domain. Such modelling, useful for structuring such a recent interaction domain, and to facilitate design and evaluation from both software engineering and ergonomics perspectives, is based on the combination of two approaches: the ASUR notation and an ergonomic recommendations-based model. Both approaches are presented as well as the results of their combination. The resulting model, an extension of the ASUR notation, is described as well as its limits and perspectives.

No abstract

No abstract