Example‐based synthesis for sound of ocean waves caused by bubble dynamics

Wang, Kai; Liu, Shiguang

doi:10.1002/cav.1835

Cited by 9 publications

(6 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the field of graphics, researchers have developed methods that use the nonphysical methods to automatically synthesize sounds synchronized with animation, and the parameters are obtained from physics-based animation. [17][18][19] An et al 17 proposed a sound synthesis method for the fabric animation, in which the sound grains matching 3D animation was selected based on the Mel-Frequency Cepstrum Coefficient (MFCC) of sound signal, and the selected sound grains were subsequently spliced together to synthesize the fabric sound. The principles of sound grain algorithm are referenced in this paper.…”

Section: Related Workmentioning

confidence: 99%

Toward a cylinder pressure signals-based active synthesis algorithm for engine sound

Xie

Liu

et al. 2022

Proceedings of the Institution of Mechanical Engineers, Part D:

View full text Add to dashboard Cite

The active sound design (ASD) technology is one of the most flexible methods to achieve the diverse design of automobile sound, in which the active sound synthesis algorithm is essential. However, in previous works, the discontinuity phenomena always appear in the synthesized sound. Thus, a new method of active engine sound synthesis based on cylinder pressure signals is proposed in this paper for the sound synthesis algorithm of ASD technique. Firstly, the index matrix of sound grains is constructed based on the periodicity of engine cylinder pressure signal. Then the frame length and frame shift are defined by tracing the time step of Revolutions Per Minute (RPM) of engine, and the hamming window function is constructed to extract sound grains. Subsequently, the overlap-and-add (OLA) method is used to realize the synthesis of engine sounds with different durations. In addition, the code program of proposed algorithm is written and the ASD prototype system is built respectively to synthesize the engine sounds. Finally, a similarity evaluation metric is defined to verify the effectiveness of proposed algorithm. The results show that our algorithm not only restitutes the main features of original sound, but also satisfies both the real-time feedback on the driving status and the continuity of synthesized sound. It contributes to the development of real-time ASD engineering for automobiles.

show abstract

Section: Related Workmentioning

confidence: 99%

Toward a cylinder pressure signals-based active synthesis algorithm for engine sound

Xie

Liu

et al. 2022

Proceedings of the Institution of Mechanical Engineers, Part D:

View full text Add to dashboard Cite

show abstract

“…Wang and Liu [237] proposed a hybrid method to generate the sound of wave animation based on available wave sound samples and bubble extraction. Based on the theory of bubbles as the main sound source, they generated bubble particles to ensure the synchronization between visual and sound effects.…”

Section: Liquid Soundmentioning

confidence: 99%

Sound Synthesis, Propagation, and Rendering: A Survey

Liu,

Manocha

2020

Preprint

Self Cite

View full text Add to dashboard Cite

Sound, as a crucial sensory channel, plays a vital role in improving the reality and immersiveness of a virtual environment, following only vision in importance. Sound can provide important clues such as sound directionality and spatial size. This paper gives a broad overview of research works on sound simulation in virtual reality, games, etc. We first survey various sound synthesis methods, including harmonic synthesis, texture synthesis, spectral analysis, and physics-based synthesis. Then, we summarize popular sound propagation techniques, namely wave-based methods, geometric-based methods, and hybrid methods. Next, the sound rendering methods are reviewed. We also highlight some recent methods that use machine learning techniques for synthesis, propagation, and some inverse problems.

show abstract

“…In the computer graphics community, researchers have developed nonphysical methods to automatically synthesize synchronized sounds with animation. [12][13][14] The data used for synchronization are derived from physical-based animation. A data-driven method for automatically synthesizing plausible sound for cloth animations was proposed by An et al.…”

Section: Sound Synthesismentioning

confidence: 99%

“…In the computer graphics community, researchers have developed nonphysical methods to automatically synthesize synchronized sounds with animation 12‐14 . The data used for synchronization are derived from physical‐based animation.…”

Section: Related Workmentioning

confidence: 99%

Animating explosion with exploding sound and rigid‐body sound

Liu

Gao

2020

Computer Animation & Virtual

Self Cite

View full text Add to dashboard Cite

Visual simulation of explosion animation can be found many applications in virtual reality. In addition to visual simulation, sound synthesis of explosion scenes is also indispensable. However, little attention has been paid to this research area. To this end, this paper proposes an automatic sound synthesis method for explosion scenes. Explosion animation consists of two major events, namely explosive event and interactive rigid-body fracture event. Correspondingly, the sound for an explosion scene can be viewed as the combination of two components, that is, the exploding sound and the rigid-body sound. Among them, the exploding sound often shows similarity in terms of characteristics in frequency domain, while the rigid-body sound is rich in variations due to the unpredictable motion state and different materials of debris. As a result, for the synthesis of the rigid-body sound, firstly, we extract the rigid-body sounds from recording examples by the empirical mode decomposition method. On this basis, a new spectral flux based approach is developed to segment the extracted sounds into a grain dictionary. Then, a cascade sound synthesis method based on impulse response is designed to synchronize the rigid-body sound for fracture events. For the synthesis of exploding sound, due to its similar characteristics in frequency domain, an example-based automatic sound synthesis method is adapted in this paper. Finally, we propose a priority-aware sound blending method to merge these two types of completely different sounds reasonably. Various experimental results demonstrated the effectiveness of our new method.

show abstract

Example‐based synthesis for sound of ocean waves caused by bubble dynamics

Cited by 9 publications

References 31 publications

Toward a cylinder pressure signals-based active synthesis algorithm for engine sound

Toward a cylinder pressure signals-based active synthesis algorithm for engine sound

Sound Synthesis, Propagation, and Rendering: A Survey

Animating explosion with exploding sound and rigid‐body sound

Contact Info

Product

Resources

About