Comparison of unsupervised sequence adaptations for deep neural networks

Kobayashi, Akio; Onoe, Kazuo; Ichiki, Manon; Sato, Shoei

doi:10.1109/icassp.2016.7472801

Cited by 1 publication

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Few approaches have been proposed in the literature. A simple approach, referred to as fine-tuning [8,9,10] that works quite well, includes an additional epoch of training some or all layers of the network with the adaptation data alone. This approach has been so powerful, that it has been used successfully to even adapt a multilingual neural network to the target language of interest [11,12,13].…”

Section: Introductionmentioning

confidence: 99%

Domain Adaptation of CNN Based Acoustic Models Under Limited Resource Settings

et al. 2016

View full text Add to dashboard Cite

Adaptation of Automatic Speech Recognition (ASR) systems to a new domain (channel, speaker, topic, etc.) remains a significant challenge, as often, only a limited amount of target domain data for adaptation of Acoustic Models (AMs) is available. However, unlike GMMs, to date, there has not been an established, efficient method for adapting current state-of-theart Convolutional Neural Network (CNN)-based AMs. In this paper, we explore various training algorithms for domain adaptation of CNN based speech recognition systems with limited acoustic training data resources. Our investigations illustrate the following three main contributions. First, introducing a weight decay based regularizer along with the standard cross entropy criteria can significantly improve recognition performances with as little as one hour of adaptation data. Second, the observed gains can be improved further with the state-level Minimum Bayes Risk (sMBR) based sequence training technique. In addition to supervised training with limited amounts of data, we also study the effect of introducing unsupervised data at both the initial cross-entropy and subsequent sequence training stages. Our experiments show that unsupervised data helps with cross-entropy and sequence training criteria. Third, the effect of speaker diversity in the adaptation data is also investigated where our experiments show that although there can be large variance in final performance depending on the speakers selected, regularization is required to obtain significant gains. Overall, we demonstrate that with adaptation of neural network based acoustic models, we can obtain performance improvements of up to 24.8% relative.

show abstract