Abstract.A growing number of research projects in academia and industry have recently started to develop lifelike agents as a new metaphor for highly personalised human-machine communication. A strong argument in favour of using such characters in the interface is the fact that they make humancomputer interaction more enjoyable and allow for communication styles common in human-human dialogue. Our earlier work in this area has concentrated on the development of animated presenters that show, explain, and verbally comment textual and graphical output on a window-based interface. Even though first empirical studies have been very encouraging and revealed a strong affective impact of our Personas [23], they also suggest that simply embodying an interface agent is insufficient. To come across as believable, an agent needs to incorporate a deeper model of personality and emotions, and in particular directly connect these two concepts.

No abstract

Multimodal interfaces combining natural language and graphics take advantage of both the individual strength of each communication mode and the fact that several modes can be employed in parallel. The central claim of this paper is that the generation of a multimodal presentation can be considered as an incremental planning process that aims to achieve a given communicative goal. We describe the multimodal presentation system WIP which allows the generation of alternate presentations of the same content taking into account various contextual factors. We discuss how the plan-based approach to presentation design can be exploited so that graphics generation influences the production of text and vice versa. We show that wellknown concepts from the area of natural language processing like speech acts, anaphora, and rhetorical relations take on an extended meaning in the context of multimodal communication. Finally, we discuss two detailed examples illustrating and reinforcing our theoretical claims.

No abstract

No abstract