Reactive memories: an interactive talking-head

Devin, Vincent; Hogg, David C.

doi:10.1016/j.imavis.2003.08.009

Cited by 9 publications

(5 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…PCA has also been used in a similar manner to that proposed here by Devin and Hogg [6], in which a synthetic talking head is generated using a model of joint behaviour. The generative response of the head to a users interaction is created using a Hidden Markov Model and a leaky neural network.…”

Section: Previous Workmentioning

confidence: 99%

Practical generation of video textures using the auto-regressive process

Campbell

Dalton

Gibson

et al. 2004

Image and Vision Computing

View full text Add to dashboard Cite

Section: Previous Workmentioning

confidence: 99%

Practical generation of video textures using the auto-regressive process

Campbell

Dalton

Gibson

et al. 2004

Image and Vision Computing

View full text Add to dashboard Cite

“…The Interactive Music Head collaborative projects integrates the MMS with a real-time face (and expression) tracker from an ongoing research project, which aims to create a synthetic talking head intended for mediating interaction between humans and machines (Devin and Hogg 2001). Figure 8 shows the triangulated facial expression, and figure 9 illustrates the real-time face tracker system.…”

Section: Interactive Music Headmentioning

confidence: 99%

Sensing and mapping for interactive performance

Ng¹

2002

Org. Sound

View full text Add to dashboard Cite

This paper describes a trans-domain mapping (TDM) framework for translating meaningful activities from one creative domain onto another. The multi-disciplinary framework is designed to facilitate an intuitive and non-intrusive interactive multimedia performance interface that offers the users or performers real-time control of multimedia events using their physical movements. It is intended to be a highly dynamic real-time performance tool, sensing and tracking activities and changes, in order to provide interactive multimedia performances.From a straightforward definition of the TDM framework, this paper reports several implementations and multi-disciplinary collaborative projects using the proposed framework, including a motion and colour-sensitive system, a sensor-based system for triggering musical events, and a distributed multimedia server for audio mapping of a real-time face tracker, and discusses different aspects of mapping strategies in their context. Plausible future directions, developments and exploration with the proposed framework, including stage augmentation, virtual and augmented reality, which involve sensing and mapping of physical and non-physical changes onto multimedia control events, are discussed.

show abstract

“…A lot of work has been done for expression classification [2,8,17,5,1]. Some of these systems do not deal with classification directly [2,8] and are focused on the synthesis process, others treat the classification as a on/off state process [17,5,1] which is nowhere near acceptable for continuous and realistic animation.…”

Section: Introductionmentioning

confidence: 99%