Spatialized Synthesis of Noisy Environmental Sounds

Verron, Charles; Aramaki, Mitsuko; Kronland‐Martinet, Richard; Pallone, Grégory

doi:10.1007/978-3-642-12439-6_20

Cited by 6 publications

(3 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Indeed, the characterization of each elementary time-localized sound component, that is generally limited to its amplitude, frequency and phase, was augmented by its spatial position in the 3D space. This tremendous addition leads to an increasing number of control possibilities while still being real time compatible thanks to an accurate use of the granular synthesis process in the frequency domain [34]. We then showed that the control of the spatial distribution of the partials together with the construction of decorrelated versions of the actual sound allowed for the control of the spatial position of the sound source together with the control of its perceived spatial width.…”

Section: Control Of the Environmental Sound Synthesizermentioning

confidence: 95%

Perceptual Control of Environmental Sound Synthesis

Aramaki

Kronland‐Martinet

Ystad

2012

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

In this article we explain how perceptual control of synthesis processes can be achieved through a multidisciplinary approach relating physical and signal properties of sound sources to evocations induced by sounds. This approach is applied to environmental and abstract sounds in 3 different experiments. In the first experiment a perceptual control of synthesized impact sounds evoking sound sources of different materials and shapes is presented. The second experiment describes an immersive environmental synthesizer simulating different kinds of environmental sounds evoking natural events such as rain, waves, wind and fire. In the last example motion evoked by abstract sounds is investigated. A tool for describing perceived motion through drawings is proposed in this case.

show abstract

Section: Control Of the Environmental Sound Synthesizermentioning

confidence: 95%

Perceptual Control of Environmental Sound Synthesis

Aramaki

Kronland‐Martinet

Ystad

2012

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

show abstract

“…Two practical applications are to enhance the auditory menu cues for the in-vehicle technologies [26] and to design warning signals for critical traffic situations for car drivers [14]. Signal-based sound synthesis transformed from the environment can be one of the sonfication implementations [46], while MIDI-based system employs sonification to assist program understanding by rendering sonic cues [24,47]. Although the research uses prosody specification to obtain the document-to-audio semantic…”

Section: Sonificationmentioning

confidence: 99%

Algorithmic approach to sonification of classical Chinese poetry

Huang¹,

Lu²,

Ren³

2011

Multimed Tools Appl

View full text Add to dashboard Cite

The classical Chinese poetry is a remarkable form of art in traditional Chinese character. However, it is difficult for people who are unfamiliar with ancient Chinese to experience the artistic content of the poetry. In this study, a sonification scheme, Tx2Ms (Text-to-Music), is proposed to extract the poetry features between lines in verses; moreover, dynamics and interval relations are modeled to map those features to the movement of multi-dimensional musical elements such as durations. This conversion is based on poetry intonation and acoustic analysis of the pronunciations of poems; and a stochastic compositional algorithm is created by applying a Markov chain. In addition, the best pentatonic mode for a specific poem is recommended according to the formants analysis. Therefore, the sonification of classical Chinese poetry not only provides a novel way for people to appreciate Chinese poetry but also enriches the state of mind and imagery in the delivery process, and the experiment results show that the proposed system is successfully accepted by most people.

show abstract

“…An approach for overcoming the limitation of the IFFT method consists in using different window lengths according to the type of sound [26]. However, as we show in Section VI-B, this approach does not permit the synthesis of short transients in narrow noisy components.…”

mentioning

confidence: 99%

Time–Frequency Synthesis of Noisy Sounds With Narrow Spectral Components

Marelli

Aramaki

Kronland‐Martinet

et al. 2010

IEEE Trans. Audio Speech Lang. Process.

View full text Add to dashboard Cite

The inverse fast Fourier transform (FFT) method was proposed to alleviate the computational complexity of the additive sound synthesis method in real-time applications, and consists in synthesizing overlapping blocks of samples in the frequency domain. However, its application is limited by its inherent tradeoff between time and frequency resolution. In this paper, we propose an alternative to the inverse FFT method for synthesizing colored noise. The proposed approach uses subband signal processing to generate time-frequency noise with an autocorrelation function such that the noise obtained after converting it to time domain has the desired power spectral density. We show that the inverse FFT method can be interpreted as a particular case of the proposed method, and therefore, the latter offers some extra design flexibility. Exploiting this property, we present experimental results showing that the proposed method can offer a better tradeoff between time and frequency resolution, at the expense of some extra computations.

show abstract

Spatialized Synthesis of Noisy Environmental Sounds

Cited by 6 publications

References 28 publications

Perceptual Control of Environmental Sound Synthesis

Perceptual Control of Environmental Sound Synthesis

Algorithmic approach to sonification of classical Chinese poetry

Time–Frequency Synthesis of Noisy Sounds With Narrow Spectral Components

Contact Info

Product

Resources

About