Steps of Pre-processing for English to Mizo SMT System

Devi, Chanambam Sveta; Purkayastha, Bipul Syam

doi:10.1007/978-981-15-6318-8_14

Cited by 5 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[24] discussed the development of various applications of NLP for Mizo Language and the pre-processing steps for English to Mizo SMT system. [25] trained an NMT system for English to Mizo on a parallel corpus of 10,675 sentences and evaluated it on a test dataset of 100 sentences. The author reported that the MT system prediction is reasonable based on fluency but worse on accuracy.…”

Section: Related Workmentioning

confidence: 99%

An empirical study on English-Mizo Statistical Machine Translation with Bible Corpus

Devi

Meetei

Purkayastha

2022

Int. j. electr. comput. eng. syst. (Online)

View full text Add to dashboard Cite

Machine Translation (MT) is the process of automatically converting the text or speech in one natural language to another language with the help of a machine. This work presents a Bidirectional Statistical Machine Translation (SMT) system of an extremely low resource language pair Mizo-English, built in a low resource setting. A total of 30800 sentences are collected from the English Bible dataset and manually translated to Mizo by a native linguistic expert to generate the English-Mizo parallel dataset. After subjecting to various pre-processing steps, the parallel dataset is used to build our MT system using MOSES tools. Our framework uses different tools, such as GIZA++ for creating the Translation Model (TM) and IRSTLM to determine the probability of the target model. The quality of our MT system is evaluated using two automatic evaluation metrics: BLEU and METEOR. Our MT systems are also manually evaluated using two parameters: adequacy and fluency.

show abstract

Section: Related Workmentioning

confidence: 99%