Speech Enhancement-assisted Voice Conversion in Noisy Environments

Chan, Yun-Ju; Peng, Chiang-Jen; Wang, Syu-Siang; Wang, Hsin‐Min; Tsao, Yu; Chi, Tai-Shih

doi:10.23919/apsipaasc55919.2022.9979851

Cited by 1 publication

(1 citation statement)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Clean references are necessary as the SE and TTS models are jointly trained. In a similar vein, Chan et al [22] adopted a lightweight SE component to preprocess noisy data for VC downstream, necessitating clean speech data because the SE and VC components are jointly trained. Miao et al [23] realized noise-robust VC by implementing two filtering methods in the pre-and post-processing stages.…”

Section: B Noise-robust Vc With Speech Enhancement Methodsmentioning

confidence: 99%

Noisy-to-Noisy Voice Conversion Under Variations of Noisy Condition

Xie,

Toda

2023

IEEE/ACM Trans. Audio Speech Lang. Process.

View full text Add to dashboard Cite

Voice conversion (VC) refers to the transformation of the speaker identity of a speech to the target one without altering the linguistic content. As recent VC techniques have made significant progress, implementing them in real-world scenarios is also considered, where speech data have some inevitable interferences, the most common of which are background sounds. On the other hand, background sounds are informative and need to be retained in some applications, such as VC in movies/videos. To address these issues, we have proposed a noisy-to-noisy (N2N) VC framework that does not rely on clean VC data and models the noisy speech directly by using noise as conditions. Previous experimental results have proven its effectiveness. In this paper, we further improve its performance by introducing the pretrained noise-conditioned VC model. Moreover, to further explore the impacts of introducing noise conditions, the performance in more realistic situations is evaluated in which the training set possesses speaker-dependent noisy conditions. The experimental results demonstrate the effectiveness of the pre-training strategy and the degradation of its performance under strict noisy conditions. We then proposed a noise augmentation method to overcome the limitation. Further experiments showed the effectiveness of the augmentation method.

show abstract

Section: B Noise-robust Vc With Speech Enhancement Methodsmentioning

confidence: 99%