Extraction of Root Words using Morphological Analyzer for Devanagari Script

Abstract

Abstract-In India, more than 300 million people use Devanagari script for documentation. In Devanagari script, Marathi and Hindi are mainly used as primary language of Maharashtra state and national language of India respectively. As compared with English script, Devanagari script is reach of morphemes. Thus the lemmatization of Devanagari script is quite complex than that of English script. There is lack of resources for Devanagari script such as WordNet, ontology representation, parsing the keywords and their part of speech. Thus the overall task of information retrieval becomes complex and time consuming. Devanagari script document always carries suffixes which may cause problem in accurate information retrieval. We propose a method of extracting root words from Devanagari script document which can be used for information retrieval, text summarization, text categorization, ontology building etc. An attempt is made to design the Morphological Analyzer for Devanagari script. We have designed CORPUS containing more than 3000 possible stop words and suffixes for Marathi language. Morphological Analyzer can acts as a preliminary stage for developing any information retrieval application in Devanagari script. We have conducted the experiments on randomly selected Marathi documents and we found the accuracy of designed morphological analyzer is up to 96%.

Influence of GUJarati STEmmeR in Supervised Learning of Web Page Categorization

“…In the literature review, the researcher found very few resources for stemming processing on the Gujarati language. So, it is an urgent need to develop a mature stemming algorithm which can help for several Indian languages including Gujarati, Marathi [44], Odia, and Pashto.…”

A Systematic Literature Review on Spell Checkers for Bangla Language

“…Stemming can reduce dictionary size which is utilized as a part of different natural language processing applications, particularly for highly inflected languages. However, it is easy to extract root words by applying stemming algorithm for language like English [31]. The design of stemmers is language specific and requires some to significant linguistic expertise in the language, as well as the understanding of the needs for a spelling checker for that language [9].…”