A user study of neural interactive translation prediction

Knowles, Rebecca; Sanchez-Torron, Marina; Koehn, Philipp

doi:10.1007/s10590-019-09235-8

Cited by 82 publications

(79 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several works aimed at building more productive NMT systems. Related to our work, studies on interactive NMT systems (Knowles and Koehn, 2016;Peris et al, 2017;Hokamp and Liu, 2017) proved the efficacy of this framework. A body of work has been done aiming to build adaptive NMT systems, which continuously learn from human corrections (Turchi et al, 2017;Peris and Casacuberta, 2018b).…”

Section: Related Worksupporting

confidence: 54%

Active Learning for Interactive Neural Machine Translation of Data Streams

Peris¹,

Casacuberta²

2018

Proceedings of the 22nd Conference on Computational Natural Language Learning

View full text Add to dashboard Cite

We study the application of active learning techniques to the translation of unbounded data streams via interactive neural machine translation. The main idea is to select, from an unbounded stream of source sentences, those worth to be supervised by a human agent. The user will interactively translate those samples. Once validated, these data is useful for adapting the neural machine translation model.We propose two novel methods for selecting the samples to be validated. We exploit the information from the attention mechanism of a neural machine translation system. Our experiments show that the inclusion of active learning techniques into this pipeline allows to reduce the effort required during the process, while increasing the quality of the translation system. Moreover, it enables to balance the human effort required for achieving a certain translation quality. Moreover, our neural system outperforms classical approaches by a large margin.

show abstract

Section: Related Worksupporting

confidence: 54%

Active Learning for Interactive Neural Machine Translation of Data Streams

Peris¹,

Casacuberta²

2018

Proceedings of the 22nd Conference on Computational Natural Language Learning

View full text Add to dashboard Cite

show abstract

“…Additionally, in a hypothetical real application, the inclusion of an interactive correction process could be considered. Interactive neural systems provide encouraging results (Knowles and Koehn, 2016;Peris et al, 2017) in the machine translation field. In such systems, the user corrects the errors committed by the system, the system takes into account these corrections and changes its outputs, to produce a hopefully better caption.…”

Section: Discussionmentioning

confidence: 99%

Egocentric video description based on temporally-linked sequences

Bolaños

Peris

Casacuberta

et al. 2018

Journal of Visual Communication and Image Representation

View full text Add to dashboard Cite

Egocentric vision consists in acquiring images along the day from a first person point-of-view using wearable cameras. The automatic analysis of this information allows to discover daily patterns for improving the quality of life of the user. A natural topic that arises in egocentric vision is storytelling, that is, how to understand and tell the story relying behind the pictures.In this paper, we tackle storytelling as an egocentric sequences description problem. We propose a novel methodology that exploits information from temporally neighboring events, matching precisely the nature of egocentric sequences. Furthermore, we present a new method for multimodal data fusion consisting on a multi-input attention recurrent network. We also release the EDUB-SegDesc dataset. This is the first dataset for egocentric image sequences description, consisting of 1,339 events with 3,991 descriptions, from 55 days acquired by 11 people. Finally, we prove that our proposal outperforms classical attentional encoder-decoder methods for video description.

show abstract

“…feedback, (Azadi and Khadivi, 2015;Cai et al, 2013;Green et al, 2014) improved the suffix generation, (González-Rubio et al, 2010) integrated of confidence measures in the interactive pipeline, etc. Given the recent success of NMT, this technology has also be adapted to fit into the interactive framework (Knowles and Koehn, 2016;Peris et al, 2017b). Alternative technologies, such as translation memories, also were modified to allow interaction (Green et al, 2014).…”

Section: Introductionmentioning

confidence: 99%

Online learning for effort reduction in interactive neural machine translation

Peris

Casacuberta

2019

Computer Speech & Language

View full text Add to dashboard Cite

Neural machine translation systems require large amounts of training data and resources. Even with this, the quality of the translations may be insufficient for some users or domains. In such cases, the output of the system must be revised by a human agent. This can be done in a post-editing stage or following an interactive machine translation protocol.We explore the incremental update of neural machine translation systems during the post-editing or interactive translation processes. Such modifications aim to incorporate the new knowledge, from the edited sentences, into the translation system. Updates to the model are performed on-the-fly, as sentences are corrected, via online learning techniques. In addition, we implement a novel interactive, adaptive system, able to react to single-character interactions. This system greatly reduces the human effort required for obtaining high-quality translations.In order to stress our proposals, we conduct exhaustive experiments varying the amount and type of data available for training. Results show that online learning effectively achieves the objective of reducing the human effort required during the post-editing or the interactive machine translation stages. Moreover, these adaptive systems also perform well in scenarios with scarce resources. We show that a neural machine translation system can be rapidly adapted to a specific domain, exclusively by means of online learning techniques.3. We conduct a large experimentation, using public corpora containing different features from varied domains. We stress the translation systems, applying them in three different translation scenarios. 4. We show that OL brings significant improvements to the translation engines, in terms of translation quality and human effort reduction. Comparisons with other works in the literature also show that our adaptive, interactive systems are able to outperform the existing state-of-the-art. 5. We open-source all code developed in this work, in order to make research reproducible.The rest of this manuscript is structured as follows: the related work is reviewed in Section 2. Next, Section 3 briefly introduces the NMT technology, while the interactive protocol for NMT is presented in Section 4. OL is described and applied together with INMT in Section 5. Section 6 describes the experimental setup of this work. Results are presented and discussed in Section 7. Finally, we conclude the work and trace future lines of work in Section 8. Related workThis work puts together three thoroughly studied fields: neural machine translation, interactive machine translation and online learning. In this section, we briefly review the progress made in the last years in each one of these fields. Neural machine translationAlthough the first attempts of performing machine translation with neural networks date from long ago (Castaño and Casacuberta, 1997; Forcada andÑeco, 1997), NMT only took off recently. Kalchbrenner and Blunsom (2013) reintroduced full neural MT, although the results were non-competitive with re...

show abstract

A user study of neural interactive translation prediction

Cited by 82 publications

References 25 publications

Active Learning for Interactive Neural Machine Translation of Data Streams

Active Learning for Interactive Neural Machine Translation of Data Streams

Egocentric video description based on temporally-linked sequences

Online learning for effort reduction in interactive neural machine translation

Contact Info

Product

Resources

About