A Survey of Orthographic Information in Machine Translation

Abstract

Machine translation is one of the applications of natural language processing which has been explored in different languages. Recently researchers started paying attention towards machine translation for resource-poor languages and closely related languages. A widespread and underlying problem for these machine translation systems is the variation in orthographic conventions which causes many issues to traditional approaches. Two languages written in two different orthographies are not easily comparable, but orthographic information can also be used to improve the machine translation system. This article offers a survey of research regarding orthography's influence on machine translation of under-resourced languages. It introduces under-resourced languages in terms of machine translation and how orthographic information can be utilised to improve machine translation. We describe previous work in this area, discussing what underlying assumptions were made, and showing how orthographic knowledge improves the performance of machine translation of underresourced languages. We discuss different types of machine translation and demonstrate a recent trend that seeks to link orthographic information with well-established machine translation methods. Considerable attention is given to current efforts of cognates information at different levels of machine translation and the lessons that can Bharathi Raja Chakravarthi

From Plenipotentiary to Puddingless: Users and Uses of New Words in Early English Letters

“…Normalization is a very common practice embraced in the NLP research when dealing with historical or otherwise non-standard language [7,3,29,9,43]. The benefit of normalization is that it makes non-standard orthography standard and thus enables the use of NLP tools and resources designed for modern normative data.…”

“…Lady Harley used the potentially Civil War related term incendiaries in a political discussion with her son, who later became a Parliamentarian army officer; both her and Elizabeth's use of new vocabulary focuses on the semantic class 'society » authority'. Lady Conway, on the other hand, discussed philosophical concepts with her friend and fellow philosopher, Henry More, as in (3). The OED records More's use of idolum in a publication in 1647, so both of the correspondents would have been familiar with the term.…”

NUIG-Shubhanker@Dravidian-CodeMix-FIRE2020: Sentiment Analysis of Code-Mixed Dravidian text using XLNet

“…Multilingual users have the tendency to mix linguistic units in the social media resulting in code-mixed data being easily available. The phenomenon of code-mixing is explained in [5,6,7,8,9,10] and provides an analysis on the possible reasons behind code-mixing. This is done by identifying the languages involved in the code-mixed data which looks inevitable.…”