Abstract. Alignment forms the basis of successful communication. It can be seen as the most efficient means for action coordination of cooperating agents, covering adaptation processes operating without an explicit exchange of information states. One critical condition of alignment consists of joint attention. We present work on equipping a virtual human with the capability of reaching joint attention with its human interlocutor. On the one hand, mechanisms to detect the human's focus of attention are employed. On the other hand, basic cognitive as well as intentional processes underlying the phenomenon of joint attention are incorporated in our agent's cognitive architecture. In this context, a dynamic working memory and a partner model accounting for theory of mind and intentionality are crucial constituents.

No abstract

One key aspect of the Internet of Things (IoT) is, that human machine interfaces are disentangled from the physicality of the devices. This provides designers with more freedom, but also may lead to more abstract interfaces, as they lack the natural context created by the presence of the machine. Mixed Reality (MR) on the other hand, is a key technology that enables designers to create user interfaces anywhere, either linked to a physical context (augmented reality, AR) or embedded in a virtual context (virtual reality, VR). Especially today, designing MR interfaces is a challenge, as there is not yet a common design language nor a set of standard functionalities or patterns. In addition to that, neither customers nor future users have substantial experiences in using MR interfaces.Prototypes can contribute to overcome this gap, as they continuously provide user experiences of increasing realism along the design process. We present ExProtoVAR, a tool that supports quick and lightweight prototyping of MR interfaces for IoT using VR technology.

No abstract

Abstract. Crucial for action coordination of cooperating agents, joint attention concerns the alignment of attention to a target as a consequence of attending to each other's attentional states. We describe a formal model which specifies the conditions and cognitive processes leading to the establishment of joint attention. This model provides a theoretical framework for cooperative interaction with a virtual human and is specified in an extended belief-desire-intention modal logic. keywordscooperative agents, attention, alignment, BDI, modal logic