Exploring emotions and multimodality in digitally augmented puppeteering

Liikkanen, Lassi A.; Huvio, Eero; Laitinen, Toni; André, Elisabeth

doi:10.1145/1385569.1385627

Cited by 7 publications

(3 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A variety of approaches and techniques have been explored to support local interaction, which usually involves some kind of installation, including bodily and mid air gestures [6], voice input [10], virtual characters, mobile phones and public displays [12], large multitouch screens [4] and a variety of other strategies [7]. Local interaction in the Lost Lab production means basically that the mobile device can be used to interact with the site-specific computing system with sensors, actuators or shared interfaces.…”

Section: Local Interactionmentioning

confidence: 99%

Lost lab of professor millennium

Kuikkaniemi

Lucero

Orso

et al. 2014

Proceedings of the 11th Conference on Advances in Computer Entertainment Technology

Self Cite

View full text Add to dashboard Cite

This paper presents a pervasive adventure production called Lost Lab of Professor Millennium that experimented with different kinds of interaction techniques evaluating how they affected the adventure experience. The paper further reflects on the practical organization of the production targeted for schools and students between 12 and 15 years of age. Groups of up to four teenagers navigated through thirteen different kinds of pervasive computing experiences in checkpoints sharing a device providing augmented reality (AR) (MapLens) on a physical map and an adaptive marker-based AR guidance. Based on a Professor who lost her technologies, the story of the adventure provided a unifying narrative also through her fish Linus guiding groups through a variety of tasks in the checkpoints. The production was evaluated with direct observations, different kinds of video recordings, interviews and questionnaires. The evaluation revealed how groups shared the devices and performed collaborative interactions with the devices. The production received positive feedback from all stakeholders, but in terms of feasibility had some drawbacks. The evaluation indicated that the markerbased AR guidance techniques is practical, reliable and easyto-use, and can be also used as a storytelling or story enhancing technique.

show abstract

Section: Local Interactionmentioning

confidence: 99%

Lost lab of professor millennium

Kuikkaniemi

Lucero

Orso

et al. 2014

Proceedings of the 11th Conference on Advances in Computer Entertainment Technology

Self Cite

View full text Add to dashboard Cite

show abstract

“…SSI provides, however, also support for the design of applications that respond directly to continuous low-level feature input. For illustration, let us have a look at the PuppetWall showcase [8]. In this CALLAS showcase, a user may change the atmosphere of a drawing by the acoustics of his voice.…”

Section: Building Concrete Oer Systems With Ssimentioning

confidence: 99%

Smart sensor integration: A framework for multimodal emotion recognition in real-time

Wagner

André

Jung

2009

2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops

Self Cite

View full text Add to dashboard Cite

Affect sensing by machines has been argued as an essential part of next-generation human-computer interaction (HCI). To this end, in the recent years a large number of studies have been conducted, which report automatic recognition of emotion as a difficult, but feasible task. However, most effort has been put towards offline analysis, whereas to date only few applications exist, which are able to react to a user's emotion in real-time. In response to this deficit we introduce a framework we call Smart Sensor Integration (SSI), which considerably jump-starts the development of multimodal online emotion recognition (OER) systems. In particular SSI supports the pattern recognition pipeline by offering tailored tools for data segmentation, feature extraction, and pattern recognition, as well as, tools to apply them offline (training phase) and online (real-time recognition). Furthermore, it has been designed to handle input from various input modalities and to suit the fusion of multimodal information.

show abstract

“…• PuppetWall: In the PuppetWall showcase by Helsinki University of Technology (TKK) [9], a user may influence a 2D graphics by the movements of physical puppets and the emotional tone of his or her voice. In contrast to the other showcases where the system responds to emotional states, PuppetWall is controlled by acoustic features of the user's voice (Fig.…”

Section: Introductionmentioning

confidence: 99%