Recognizing Textual Entailment in Non-english Text via Automatic Translation into English

Abstract

Abstract. We show that a task that typically involves rather deep semantic processing of text-being recognizing textual entailment our case study-can be successfully solved without any tools at all specific for the language of the texts on which the task is performed. Instead, we automatically translate the text into English using a standard machine translation system, and then perform all linguistic processing, including syntactic and semantic levels, using only English language linguistic tools. In this case study we use Italian annotated data. Textual entailment is a relation between two texts. To detect it, we use various measures, which allow us to make entailment decision in the two-way classification task (YES / NO). We set up various heuristics and measures for evaluating the entailment between two texts based on lexical relations. To make entailment judgments, the system applies named entity recognition module, chunking, partof-speech tagging, n-grams, and text similarity modules to both texts, all those modules being for English and not for Italian. Rules have been developed to perform the two-way entailment classification. Our system makes entailment judgments basing on the entailment scores for the text pairs. The system was evaluated on Italian textual entailment data sets: we trained our system on Italian development datasets using the WEKA machine learning toolset and tested it on Italian test data sets. The accuracy of our system on the development corpus is 0.525 and on the test corpus is 0.66, which is a good result given that no Italian-specific linguistic information was used.

Natural language inference for Malayalam language using language agnostic sentence representation

“…Alignment based approaches are used in the Arabic language for textual entailment recognition ( Boudaa, El Marouani & Enneya, 2019 ; Etaiwi & Awajan, 2020 ). RTE attempts with the Italian EVALITA dataset includes translation based approaches ( Pakray et al, 2012 ).…”

Siamese Networks for Inference in Malayalam Language Texts

“…Entailment recognition has been part of Competition on Legal Information Extraction / Entailment, where sentence encoding and decomposable attention models perform entailment recognition in the context of legal texts (Son et al, 2017). Automatic translation-based approaches are used in the Italian dataset, where the dataset is translated into the English language for entailment recognition (Pakray et al, 2012).…”

Natutal language processing: Perspective of CIC-IPN

“…A simple workaround for this problem is automatic translation, which should in principle preserve meaning: translate all involved texts into English and solve the semantic problem there [56]; the resulting methodology is, thus, language-independent [57]. We used web-based translation engine for the RTE task [58].…”