Recognizing self in puppet controlled virtual avatars

Mazalek, Ali; Nitsche, Michael; Chandrasekharan, Shailesh; Welsh, Tim; Clifton, Paul; Quitmeyer, Andrew; Peer, Firaz; Kirschner, Friedrich

doi:10.1145/1823818.1823825

Cited by 14 publications

(10 citation statements)

References 12 publications

(10 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…According to the previous studies [33][34][35], through the feedback of their own movement, visual observation or the feedback of avatar's (3D virtual character's) motion [36], humans can recognize and coordinate their movements better. The motion control module is the core of the system, which has two main functions: movement control and recognizing.…”

Section: Motion Controlmentioning

confidence: 99%

Hand gesture-based interactive puppetry system to assist storytelling for children

et al. 2016

View full text Add to dashboard Cite

Digital techniques have been used to assist narrative and storytelling, especially in many pedagogical practices. With the rapid development of HCI techniques, saturated with digital media in their daily lives, young children, demands more interactive learning methods and meaningful immersive learning experiences. In this paper, we propose a novel hand gesture-based puppetry storytelling system which provides a more intuitive and natural human computer interaction method for young children to develop narrative ability in virtual story world. Depth motion sensing and hand gestures control technology is utilized in the implementation of user-friendly interaction. Young players could intuitively use hand gestures to manipulate virtual puppet to perform story and interact with different items in virtual environment to assist narration. Based on the result of the evaluation, this novel digital storytelling system shows positive pedagogical functions on children's narrating ability as well as the competencies of cognitive and motor coordination. The usability of the system is preliminary examined in our test, and the results which showed that young children can benefit from playing with Puppet Narrator.

show abstract

Section: Motion Controlmentioning

confidence: 99%

Hand gesture-based interactive puppetry system to assist storytelling for children

et al. 2016

View full text Add to dashboard Cite

show abstract

“…Motion control Recent research on neuroscience found that in human brain development there is a strong connection between perception, imagination and movement. According to previous studies [24][25][26], through the feedback of their own movement visual observation or the feedback of avatar's (3D virtual character's) motion [27], human can recognize and coordinate with their movements better.…”

Section: B Input Data Processingmentioning

confidence: 99%

Puppet Narrator: Utilizing Motion Sensing Technology in Storytelling for Young Children

Liang

Chang

Kazmi

et al. 2015

2015 7th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games)

View full text Add to dashboard Cite

“…There was cognitive disconnect in the relation of physical movements to DP results [13,15]. This eroded the concept of self in the DP, and would not translate well to a PUI.…”

Section: G Microphone Control -Phoneme Recognition Lip Synchmentioning

confidence: 99%

“…Hand and finger operation to perform these movements also required complex coordination [13,15], and therefore also served to distance the user from the DP.…”

Section: G Microphone Control -Phoneme Recognition Lip Synchmentioning

confidence: 99%

Lessons from Digital Puppetry: Updating a Design Framework for a Perceptual User Interface

Ferguson

2015

2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable,

View full text Add to dashboard Cite

obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.The WestminsterResearch online digital archive at the University of Westminster aims to make the research output of the University available to a wider audience. Copyright and Moral Rights remain with the authors and/or copyright owners.Whilst further distribution of specific materials from within this archive is forbidden, you may freely distribute the URL of WestminsterResearch: ((http://westminsterresearch.wmin.ac.uk/). Abstract-While digital puppeteering is largely used just to augment full body motion capture in digital production, its technology and traditional concepts could inform a more naturalized multi-modal human computer interaction than is currently used with the new perceptual systems such as Kinect. Emerging immersive social media networks with their fully live virtual or augmented environments and largely inexperienced users would benefit the most from this strategy. This paper intends to define digital puppeteering as it is currently understood, and summarize its broad shortcomings based on expert evaluation. Based on this evaluation it will suggest updates and experiments using current perceptual technology and concepts in cognitive processing for existing human computer interaction taxonomy. This updated framework may be more intuitive and suitable in developing extensions to an emerging perceptual user interface for the general public.

show abstract

Recognizing self in puppet controlled virtual avatars

Cited by 14 publications

References 12 publications

Hand gesture-based interactive puppetry system to assist storytelling for children

Hand gesture-based interactive puppetry system to assist storytelling for children

Puppet Narrator: Utilizing Motion Sensing Technology in Storytelling for Young Children

Lessons from Digital Puppetry: Updating a Design Framework for a Perceptual User Interface

Contact Info

Product

Resources

About