Exploring Visualizations in Real-time Motion Capture for Dance Education

Abstract

In this paper, we describe an ongoing work towards developing a whole-body interaction interface for exploring different visualizations of movement, using real-time motion capture and 3D models, to apply in dance learning and improvisation within a creative, gamified context. A full inertial motion capture system is used by the performer while a simple user interface provides the option to the user to experiment with different avatars, and visualizations e.g., trace of motions on different parts of the body and to interact with virtual objects. The 3D simulation provides a real-time visual feedback for the movement. The interaction follows the paradigm of moving from mimicking kinetic material into a self-reflection teaching approach. The interactive avatar is the reflection of the performer, but on the same time the avatar depicts a character, a dance partner which can inspire the user who moves to explore different ways of moving. Either within the framework of artistic experimentation and creativity, or in the context of education, the visual metaphors of movement shape and qualities consist a powerful tool and raise many scientific and research questions.

Designing Glitch Procedures and Visualisation Workflows for Markerless Live Motion Capture of Contemporary Dance

“…Finally, amongst the extensive literature on visualisations of (dance) motion capture data, we consider Tsampounaris et al's work, in exploring visualisations in real-time motion capture, most relevant for the discussion of our case study [11]. These authors present visualisation variations of the same motion capture data, accessible through a custom-built UI.…”

Digital Dance Ethnography

“…Other methods focus on automatically evaluating dance performances compared to pre-captured samples, aiming to provide visual feedback to the performer in a 3D virtual environment, e.g., in martial arts [51], dance [1,2,18,27,36,94,96], ballet [64], and folk dancing [7,22,60,65,67]. Other works introduce different whole-body interaction interfaces for exploring various visualizations in dance learning and gamification [35,70,97]. Iris et al [57] have recently presented a detailed review on methods for digitization and visualization of folk dances in cultural heritage.…”

Arquivos digitais em dança

“…Criar locais que permitissem mover materiais do repertório, constituindo, assim, arquivos de dança seria um modo de construir memórias das danças? Bernard (2001) Constata-se, assim, que o uso de sistemas de captura de movimentos tem sido cada vez mais utilizado em dança (DELAHUNTA, 2018;HACHIMURA et al, 2002;MEADOR et al, 2004;TSAMPOUNARIS et al, 2016;VINCS, BARBOUR, 2014). Hachimura et al (2002) No que concerne aos arquivos que buscam elaborar modos de registros baseados em tecnologias de captura e tratamento digital de movimentos, é necessário investimento em equipes multidisciplinares que efetivamente coloquem a tecnologia a serviço da dança, neutralizando, de certo modo, os efeitos de deslumbramento causados pela virtualização do corpo humano em movimento.…”