Stemming Text-based Web Page Classification using Machine Learning Algorithms: A Comparison

Abstract

The research aim is to determine the effect of word-stemming in web pages classification using different machine learning classifiers, namely Naïve Bayes (NB), k-Nearest Neighbour (k-NN), Support Vector Machine (SVM) and Multilayer Perceptron (MP). Each classifiers' performance is evaluated in term of accuracy and processing time. This research uses BBC dataset that has five predefined categories. The result demonstrates that classifiers' performance is better without word stemming, whereby all classifiers show higher classification accuracy, with the highest accuracy produced by NB and SVM at 97% for F1 score, while NB takes shorter training time than SVM. With word stemming, the effect on training and classification time is negligible, except on Multilayer Perceptron in which word stemming has effectively reduced the training time.

Building a Multilevel Inflection Handling Stemmer to Improve Search Effectiveness for Urdu Language

“…Text stemming is a complicated and crucial step in many query systems, indexing, web search engines, and IR systems [1]- [5], document classification [6], [7], and linguistic feature extraction [3]. It provides the benefit of reducing the storage requirements by truncating redundant terms [8].…”