A Hybrid Network Model for Tibetan Question Answering

Abstract

Currently, research on question answering (QA) with deep learning methods is a hotspot in natural language processing. In addition, most of the research mainly focused on English or Chinese since there are large-scale open corpora, such as WikiQA or DoubanQA. However, how to use deep learning methods to QA of the low resource languages, like Tibetan becomes a challenge. In this paper, we propose a hybrid network model for the Tibetan QA, which combines the convolutional neural network and long short memory network (LSTM) to extract effective features from small-scale corpora. Meanwhile, since the strong grammar rules of Tibetan, we use the language model to decode the output of the LSTM layer which makes the answer more accurate and smoother. In addition, we add the batch normalization to accelerate deep network training and prevent overfitting. Finally, the experiments show that the ACC@1 value of the proposed model in Tibetan QA is 126.2% higher than the baseline model. INDEX TERMS Tibetan question answering, hybrid network, convolutional neural network, long short memory network, language model.

SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis

“…Majority of RC dataset are in English. Few exceptions are Chinese datasets WebQA (Li et al, 2016) and DuReader (He et al, 2017), as well as Bulgarian (Hardalov et al, 2019) and Tibetian (Sun and Xia, 2019) Q11870 When did the term "computer science" appear? Q28900 Кто впервые использовал этот термин?…”