Combining Different Approaches to Improve Arabic Text Documents Classification

Abstract

Abstract-The objective of this research is to improve Arabic text documents classification by combining different classification algorithms. To achieve this objective we build four models using different combination methods.The first combined model is built using fixed combination rules, where five rules are used; and for each rule we used different number of classifiers. The best classification accuracy, 95.3%, is achieved using majority voting rule with seven classifiers, and the time required to build the model is 836 seconds.The second combination approach is stacking, which consists of two stages of classification. The first stage is performed by base classifiers, and the second by a meta classifier. In our experiments, we used different numbers of base classifiers and two different meta classifiers: Naï ve Bayes and linear regression. Stacking achieved a very high classification accuracy, 99.2% and 99.4%, using Naï ve Bayes and linear regression as meta classifiers, respectively. Stacking needed a long time to build the models, which is 1963 seconds using naï ve Bayes and 3718 seconds using linear regression, since it consists of two stages of learning.The third model uses AdaBoost to boost a C4.5 classifier with different number of iterations. Boosting improves the classification accuracy of the C4.5 classifier; 95.3%, using 5 iterations, and needs 1175 seconds to build the model, while the accuracy is 99.5% using 10 iterations and requires 1966 seconds to build the model.The fourth model uses bagging with decision tree. The accuracy is 93.7% achieved in 296 seconds when using 5 iterations, and 99.4% when using 10 iteration requiring 471 seconds. We used three datasets to test the combined models: BBC Arabic, CNN Arabic, and OSAC datasets. The experiments are performed using Weka and RapidMiner data mining tools. We used a platform of Intel Core i3 of 2.2 GHz CPU with 4GB RAM.The results of all models showed that combining classifiers can effectively improve the accuracy of Arabic text documents classification.

Application of Natural Language Processing Algorithms to the Task of Automatic Classification of Russian Scientific Texts

“…In many cases, ensemble algorithms have shown the results which were higher than SVM, multilayer neural network, and k-NN algorithm. Nevertheless, recent studies have shown that this does not always lead to an improvement in quality when applied to natural language texts (Abuhaiba and Dawoud, 2017), apart from requiring significant computational resources.…”

“…Based on works (Abuhaiba and Dawoud, 2017;Bourgonje et al 2018;Liu et al 2017;Semberecki and Maciejewski, 2017), it is possible to identify the models of machine learning that are most suitable for classification of textual data. Such models are: logistic regression, random forest, SVM, and artificial neural network (both feedforward and LSTM).…”

Arabic text classification using master-slaves technique

“…In [15] built four models by combining different approaches to improve Arabic text documents classification. The first combined model is built using fixed combination rules.…”

Survey on Answer Validation for Indonesian Question Answering System (IQAS)

“…They have used components in accordance with generic QAS architecture, namely: questions analyzer, document retrieval, and answers finder. They also used TfxIDF [52] and cosine similarity techniques to find answers. Next, in [25] they did hybrid system between QAS and Casebased Reasoning (CBR).…”