Blending real with virtual in 3DLife

Apostolakis, Konstantinos C.; Alexiadis, Dimitrios S.; Daras, Petros; Monaghan, David; O’Connor, Noel E.; Prestele, Benjamin; Eisert, Peter; Richard, Gaël; Zhang, Qianni; Izquierdo, Ebroul; Moussa, Maher Ben; Thalmann, Nadia Magnenat

doi:10.1109/wiamis.2013.6616123

Cited by 5 publications

(2 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To achieve a plausible and constraint-bound 3D animation flow, the data obtained by the remote capturing component of the module is received and translated to joint-specific local-coordinate orientation quaternions in the remote rendering component before the joint matrices are updated and applied in the skinning calculations taking place in the hardware-accelerated avatar rendering pipeline. The process is described in detail in Algorithm 1 [2]. The root joint's quaternion can safely be obtained by the 3 × 3 global orientation matrix sent by the capturer.…”

Section: Full Body Avatar Control Using Kinect-based Interfacementioning

confidence: 99%

“…Avateering or puppetting a virtual 3D avatar refers to the process of mapping a user's natural motoring activity and live performance to a virtual human's deforming control elements in order to faithfully reproduce the user's activity during rendering cycles. Already, a multitude of different schemes for full body avatar control exist in the scientific literature based on the skeleton tracking capabilities offered by software development kits and application programming interfaces plugging into the Kinect sensor [2,[11][12][13]. Similarly, avatar facial animation through vision-based methods has been explored following a similar approach in which facial features on the user's face are tracked via a Kinect [15] or single image acquisition methods [3,4,10] to generate animation via detailed face rigs or pre-defined blendshapes.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Natural User Interfaces for Virtual Character Full Body and Facial Animation in Immersive Virtual Worlds

Apostolakis

Daras

2015

Lecture Notes in Computer Science

View full text Add to dashboard Cite

In recent years, networked virtual environments have steadily grown to become a frontier in social computing. Such virtual cyberspaces are usually accessed by multiple users through their 3D avatars. Recent scientific activity has resulted in the release of both hardware and software components that enable users at home to interact with their virtual persona through natural body and facial activity performance. Based on 3D computer graphics methods and vision-based motion tracking algorithms, these techniques aspire to reinforce the sense of autonomy and telepresence within the virtual world. In this paper we present two distinct frameworks for avatar animation through user natural motion input. We specifically target the full body avatar control case using a Kinect sensor via a simple, networked skeletal joint retargeting pipeline, as well as an intuitive user facial animation 3D reconstruction pipeline for rendering highly realistic user facial puppets. Furthermore, we present a common networked architecture to enable multiple remote clients to capture and render any number of 3D animated characters within a shared virtual environment.

show abstract

Section: Full Body Avatar Control Using Kinect-based Interfacementioning

confidence: 99%