Syllable-based Malay word stemmer

Abstract

Abstract--Word stemmer is one of the basic and crucial text processing tools in any languages. Word Stemmer Is not only useful In morphological study but also play an Important role in word level context analysis. Due to the existence of prefix, suffix, infix and a combination of affixes in Malay word, it raises the complexity of performing stemming to Malay word. An approach to stem Malay word using syllabification algorithm is Introduced. This approach performs stemming through comparing syllable in the word thus reduces the parsing processes. The approach shows high practicality as it produces a very high accuracy in the evaluation. This paper is organized as follows: the first section described the nature Malay word stemming process. Second section discussed previous related research on Malay word stemmer. The third section provides a step-by-step explanation on the proposed stemming method. Fourth section described the evaluation process and result of the evaluation. Fifth section discussed on the limitation of the proposed method based on the evaluation result. Sixth section mentions the future work that can expanded from the current study and the final section concludes the study for this paper.

Tagging narrator’s names in Hadith text

“…The NLP research for Malay language has been carried out in the form of [5][6][7], stemming [8], part of speech tagging [5] and parsing [9][10][11]. However, there were some NLP tasks for Malay language which is yet to be explored in research such as the language recognition, stop word removal, word sense disambiguation.…”

“…In addition, the NLP research was implemented to analyze the sentence at various level of complexity. This research aimed for the Malay language, which is on Morphologic [8], Lexical [3,12], Syntactic [13][14] except for semantics.…”