Assessing naive Bayes and support vector machine performance in sentiment classification on a big data platform

Abstract

<p><span lang="EN-US">Nowadays, mining user reviews becomes a very useful mean for decision making in several areas. Traditionally, machine learning algorithms have been widely and effectively used to analyze user’s opinions on a limited volume of data. In the case of massive data, powerful hardware resources (CPU, memory, and storage) are essential for dealing with the whole data processing phases including, collection, pre-processing, and learning in an optimal time. Several big data technologies have emerged to efficiently process massive data, like Apache Spark, which is a distributed framework for data processing that provides libraries implementing several machine learning algorithms. In order to evaluate the performance of Apache Spark's machine learning library (MLlib) on a large volume of data, classification accuracies and processing time of two machine learning algorithms implemented in spark: naive </span><span>B</span><span lang="EN-US">ayes and support vector machine (SVM) are compared to the performance achieved by the standard implementation of these two algorithms on large different size datasets built from movie reviews. The results of our experiment show that the performance of classifiers running under spark is higher than traditional ones and reaches F-measure greater than 84%. At the same time, we found that under spark framework, the learning time is relatively low.</span></p>

Sentiment analysis with hotel customer reviews using FNet

“…We also measured accuracy, precision, recall, and F1-score for the BERT, LSTM, and SVM models selected in this work. These models are selected because of their extensive usage in the field of NLP [30].…”

Architecting a machine learning pipeline for online traffic classification in software defined networking using spark

“…Here comes the need for a distributed ML framework to handle these problems efficiently. Developed on top of spark, MLlib is a library that provides preprocessing, model training, and making predictions at scale on data [19]. Various ML tasks can be performed using MLlib like classification, regression, clustering, deep learning, and dimensionality reduction.…”

Applying Bayesian networks in making intelligent applications for static and dynamic unbalance diagnosis

“…The latest generation of vibration meters has more capabilities and automatic functions than its predecessors. Many units simultaneously display the full vibration spectrum of the three axes, providing an idea of what is happening with a particular machine [10]- [13]. Although today's vibration meters offer many automated features and capabilities, they still require a basic understanding of vibration analysis to use them effectively.…”