Realtime and accurate musical control of expression in singing synthesis

d’Alessandro, Nicolas; Woodruff, Pascale; Fabre, Y.; Dutoit, Thierry; Beux, Sylvain Le; Doval, Boris; d’Alessandro, Christophe

doi:10.1007/bf02884430

Cited by 13 publications

(15 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The first version of Cantor Digitalis used the causal anticausal linear voice source model (CALM) [13,28]. In the current version of Cantor Digitalis, a simpler version is used, computing only the magnitude spectrum of the glottal flow derivative (not the phase spectrum).…”

Section: A Spectral Modelmentioning

confidence: 99%

“…The effectiveness of Cantor Digitalis as a musical instrument has been demonstrated during several successful concerts by the Chorus Digitalis 13 Another application of Cantor Digitalis is the Voice Factory software [4], included in Cantor Digitalis. Thanks to this educational tool, the main concepts in the field of voice production can be manipulated and heard in real time.…”

Section: Chorus Digitalis and Voice Factorymentioning

confidence: 99%

“…5 the correct b1 coefficient expression is given in [13] 6 Additional files 1 and 2 are audio examples without and with the perturbations, for a medium vocal effort E = 0.5.…”

Section: Endnotesmentioning

confidence: 99%

“…Singing instruments have been proposed by different research groups [3,[10][11][12][13]. The graphic tablet has been proposed for approximately a decade [10,14,15] for controlling intonation and voice source variation.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Cantor Digitalis: chironomic parametric synthesis of singing

Feugère

d’Alessandro

Doval

et al. 2017

J AUDIO SPEECH MUSIC PROC.

Self Cite

View full text Add to dashboard Cite

Cantor Digitalis is a performative singing synthesizer that is composed of two main parts: a chironomic control interface and a parametric voice synthesizer. The control interface is based on a pen/touch graphic tablet equipped with a template representing vocalic and melodic spaces. Hand and pen positions, pen pressure, and a graphical user interface are assigned to specific vocal controls. This interface allows for real-time accurate control over high-level singing synthesis parameters. The sound generation system is based on a parametric synthesizer that features a spectral voice source model, a vocal tract model consisting of parallel filters for vocalic formants and cascaded with anti-resonance for the spectral effect of hypo-pharynx cavities, and rules for parameter settings and source/filter dependencies between fundamental frequency, vocal effort, and formants. Because Cantor Digitalis is a parametric system, every aspect of voice quality can be controlled (e.g., vocal tract size, aperiodicities in the voice source, vowels, and so forth). It offers several presets for different voice types. Cantor Digitalis has been played on stage in several public concerts, and it has also been proven to be useful as a tool for voice pedagogy. The aim of this article is to provide a comprehensive technical overview of Cantor Digitalis.

show abstract

Section: A Spectral Modelmentioning

confidence: 99%

Section: Chorus Digitalis and Voice Factorymentioning

confidence: 99%

“…5 the correct b1 coefficient expression is given in [13] 6 Additional files 1 and 2 are audio examples without and with the perturbations, for a medium vocal effort E = 0.5.…”

Section: Endnotesmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Cantor Digitalis: chironomic parametric synthesis of singing

Feugère

d’Alessandro

Doval

et al. 2017

J AUDIO SPEECH MUSIC PROC.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Gestures enhance the communication of intentionality and expressivity of singing (Davidson 2001;Yonezawa et al 2006;Liao 2008;Luck and Toiviainen 2008) in a way that is similar to the enhancement of speech (McNeill 2005). It is therefore not surprising that numerous human-computer interaction (HCI) applications have focused on facilitating gestural control over the quality of the singing voice (Hewitt and Stevenson 2003;Kessous 2004;Cook 2005;Yonezawa et al 2005;D'Alessandro et al 2006; Knapp and Cook 2006;D'Alessandro et al 2007;Pérez, Knapp, and Alcorn 2007;Wong 2009). Gestural control over the voice has to be carried out in the electronic/digital domain, where microfeatures of expression can be exchanged between media (for example between gesture and audio).…”

Section: Problem Definitionmentioning

confidence: 99%

The “One-Person Choir”: A Multidisciplinary Approach to the Development of an Embodied Human–Computer Interface

Maes

Leman

Kochman

et al. 2011

Computer Music Journal

View full text Add to dashboard Cite

The "One-Person Choir" is a human-computer interface for singers that facilitates gestural control over a digital signal processing (DSP) module for harmonizing the singing voice in real time (see Figure 1). Harmonization adds extra pitch-shifted voices that are tonally related to the input voice. The interface captures global movements of the upper limbs by means of an integrated network of inertial sensors attached to the upper body of a singer. From these data, gestural cues are extracted and compared with a preconfigured gestural model that has been trained with empirical data. When the gestures of the singer match the preconfigured model, it is possible to control the harmonization of the singing input voice captured by a microphone. Thus, the interface allows a singer to naturally enhance the expressive qualities of his or her voice with the assistance of expressive gestures connected to an electronic environment.The One-Person Choir can be integrated in interactive multimedia installations that exploit the expressive power of gestures in combination with singing. As will be argued in this article, installations illustrate, and elaborate on, an ongoing shift in contemporary electronic and electroacoustic music: the move from interactive systems (or hyperinstruments) to composing interactions (Di Scipio 2003).

show abstract

3D Audiovisual Rendering and Real-Time Interactive Control of Expressivity in a Talking Head

Martin

d’Alessandro

Jacquemin

et al.

Intelligent Virtual Agents

Self Cite

View full text Add to dashboard Cite

Abstract. The integration of virtual agents in real-time interactive virtual applications raises several challenges. The rendering of the movements of the virtual character in the virtual scene (locomotion of the character or rotation of its head) and the binaural rendering in 3D of the synthetic speech during these movements need to be spatially coordinated. Furthermore, the system must enable real-time adaptation of the agent's expressive audiovisual signals to user's on-going actions. In this paper, we describe a platform that we have designed to address these challenges as follows: (1) the modules enabling real time synthesis and spatial rendering of the synthetic speech, (2) the modules enabling 3D real time rendering of facial expressions using a GPU-based 3D graphic engine, and (3) the integration of these modules within an experimental platform using gesture as an input modality. A new model of phonemedependent human speech directivity patterns is included in the speech synthesis system, so that the agent can move in the virtual scene with realistic 3D visual and audio rendering. Future applications of this platform include perceptual studies about multimodal perception and interaction, expressive real time question and answer system and interactive arts.

show abstract

Realtime and accurate musical control of expression in singing synthesis

Cited by 13 publications

References 17 publications

Cantor Digitalis: chironomic parametric synthesis of singing

Cantor Digitalis: chironomic parametric synthesis of singing

The “One-Person Choir”: A Multidisciplinary Approach to the Development of an Embodied Human–Computer Interface

3D Audiovisual Rendering and Real-Time Interactive Control of Expressivity in a Talking Head

Contact Info

Product

Resources

About