User-Defined Body Gestures for an Interactive Storytelling Scenario

Kistler, Felix; André, Elisabeth

doi:10.1007/978-3-642-40480-1_17

Cited by 18 publications

(22 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Meanwhile, some digital devices, such as the Nintendo Wii, Microsoft Kinect, and Sony Move, are improving how users interact with systems, while also promoting cultural creativity through educational and recreational content [4]. Because the depth cameras used in these devices are becoming more broadly available consumer products, opportunities are emerging for such systems that are to be used in novel body-interaction techniques [5], although this poses new challenges for interaction designers. Several researchers have already begun to integrate this new form of interaction into their own interactive systems [6][7][8].…”

Section: Introductionmentioning

confidence: 99%

Exploring How Interactive Technology Enhances Gesture-Based Expression and Engagement: A Design Study

Zhao

2019

MTI

View full text Add to dashboard Cite

The interpretation and understanding of physical gestures play a significant role in various forms of art. Interactive technology and digital devices offer a plethora of opportunities for personal gesture-based experience and they assist in the creation of collaborative artwork. In this study, three prototypes for use with different digital devices (digital camera, PC camera, and Kinect) were designed. Subsequently, a series of workshops were conducted and in-depth interviews with participants from different cultural and occupational backgrounds. The latter were designed to explore how to specifically design personalised gesture-based expressions and how to engage the creativity of the participants in their gesture-based experiences. The findings indicated that, in terms of gesture-based interaction, the participants preferred to engage with the visual traces that were displayed at specific timings in multi-experience spaces. Their gesture-based interactions could effectively support non-verbal emotional expression. In addition, the participants were shown to be strongly inclined to combine their personal stories and emotions into their own gesture-based artworks. Based on the participants’ different cultural and occupational backgrounds, their artistic creation could be spontaneously formed.

show abstract

Section: Introductionmentioning

confidence: 99%

Exploring How Interactive Technology Enhances Gesture-Based Expression and Engagement: A Design Study

Zhao

2019

MTI

View full text Add to dashboard Cite

show abstract

“…Table 3 shows a comparison between several previously proposed taxonomies and the one proposed in this work. Those taxonomies were proposed as part of studies on user-defined gestures for scenarios such as augmented reality [31], humanoid robot [28], storytelling [17], controlling a drone [29], and video games [37]. The values included in the table are given as the percentage of gestures that participants proposed for each gesture type in each work.…”

Section: Discussion: Comparison With Elicitation Studiesmentioning

confidence: 99%

“…Wobbrock et al [45] introduced a methodology for eliciting gesture commands from users. Follow-up work verified this methodology for mid-air gestures [40,31,28,17,29,37]. The methodology consists of presenting non-technical users the effects of gestures and eliciting the causes meant to invoke them.…”

Section: Related Workmentioning

confidence: 96%

“…However, those findings should not be directly applied to mid-air gestures given the different behavior and body parts that can be involved. Moreover, most studies have focused on gestures produced with hands; the few ones related to gestures made with other body parts have not analyzed variability in depth (e.g., [28,17]). Consequently, the answers to the following questions are still missing: How do users perform gestures moving their hands in the air?…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Understanding Gesture Articulations Variability

Erazo

Rekik

Grisoni

et al. 2017

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Interfaces based on mid-air gestures often use a one-to-one mapping between gestures and commands, but most remain very basic. Actually, people exhibit inherent intrinsic variations for their gesture articulations because gestures carry dependency with both the person producing them and the specific context, social or cultural, in which they are being produced. We advocate that allowing applications to map many gestures to one command is a key step to give more flexibility, avoid penalizations, and lead to better user interaction experiences. Accordingly, this paper presents our results on mid-air gesture variability. We are mainly concerned with understanding variability in mid-air gesture articulations from a pure user-centric perspective. We describe a comprehensive investigation on how users vary the production of gestures under unconstrained articulation conditions. The conducted user study consisted in two tasks. The first one provides a model of user conception and production of gestures; from this study we also derive an embodied taxonomy of gestures. This taxonomy is used as a basis for the second experiment, in which we perform a fine grain quantitative analysis of gesture articulation variability. Based on these results, we discuss implications for gesture interface designs.

show abstract

“…Further details about the gesture study, the results of its analysis, and the implementation of the gesture recognition can be found in [7]. …”

Section: Gesture Studymentioning

confidence: 99%

Traveller: An Interactive Cultural Training System Controlled by User-Defined Body Gestures

Kistler

André

Mascarenhas

et al. 2013

Human-Computer Interaction – INTERACT 2013

Self Cite

View full text Add to dashboard Cite

Abstract. In this paper, we describe a cultural training system based on an interactive storytelling approach and a culturally-adaptive agent architecture, for which a user-defined gesture set was created. 251 full body gestures by 22 users were analyzed to find intuitive gestures for the in-game actions in our system. After the analysis we integrated the gestures in our application using our framework for full body gesture recognition. We further integrated a second interaction type which applies a graphical interface controlled with freehand swiping gestures.

show abstract

User-Defined Body Gestures for an Interactive Storytelling Scenario

Cited by 18 publications

References 15 publications

Exploring How Interactive Technology Enhances Gesture-Based Expression and Engagement: A Design Study

Exploring How Interactive Technology Enhances Gesture-Based Expression and Engagement: A Design Study

Understanding Gesture Articulations Variability

Traveller: An Interactive Cultural Training System Controlled by User-Defined Body Gestures

Contact Info

Product

Resources

About