Arabic Sentiment Analysis Based on Word Embeddings and Deep Learning

Abstract

Social media networks have grown exponentially over the last two decades, providing the opportunity for users of the internet to communicate and exchange ideas on a variety of topics. The outcome is that opinion mining plays a crucial role in analyzing user opinions and applying these to guide choices, making it one of the most popular areas of research in the field of natural language processing. Despite the fact that several languages, including English, have been the subjects of several studies, not much has been conducted in the area of the Arabic language. The morphological complexities and various dialects of the language make semantic analysis particularly challenging. Moreover, the lack of accurate pre-processing tools and limited resources are constraining factors. This novel study was motivated by the accomplishments of deep learning algorithms and word embeddings in the field of English sentiment analysis. Extensive experiments were conducted based on supervised machine learning in which word embeddings were exploited to determine the sentiment of Arabic reviews. Three deep learning algorithms, convolutional neural networks (CNNs), long short-term memory (LSTM), and a hybrid CNN-LSTM, were introduced. The models used features learned by word embeddings such as Word2Vec and fastText rather than hand-crafted features. The models were tested using two benchmark Arabic datasets: Hotel Arabic Reviews Dataset (HARD) for hotel reviews and Large-Scale Arabic Book Reviews (LARB) for book reviews, with different setups. Comparative experiments utilized the three models with two-word embeddings and different setups of the datasets. The main novelty of this study is to explore the effectiveness of using various word embeddings and different setups of benchmark datasets relating to balance, imbalance, and binary and multi-classification aspects. Findings showed that the best results were obtained in most cases when applying the fastText word embedding using the HARD 2-imbalance dataset for all three proposed models: CNN, LSTM, and CNN-LSTM. Further, the proposed CNN model outperformed the LSTM and CNN-LSTM models for the benchmark HARD dataset by achieving 94.69%, 94.63%, and 94.54% accuracy with fastText, respectively. Although the worst results were obtained for the LABR 3-imbalance dataset using both Word2Vec and FastText, they still outperformed other researchers’ state-of-the-art outcomes applying the same dataset.

HAPI: An efficient Hybrid Feature Engineering-based Approach for Propaganda Identification in social media

“…Moreover, the methods developed in the past can be useful for enhancing the propaganda identification systems. For example, the studies [ 58 ] and [ 59 ] proposed citation intent classification approach and the Arabic sentiment analysis mechanism respectively, demonstrates the effectiveness of word embeddings and deep learning techniques, which can be adapted to enhance context understanding and detection accuracy in our propaganda identification model. Similarly, the authors in [ 60 ] introduces a sophisticated MPAN model with multilevel parallel attention mechanisms, which can improve precision and recall by focusing on relevant parts of the text.…”

ArabBert-LSTM: improving Arabic sentiment analysis based on transformer model and Long Short-Term Memory

“…This subsection presents related work that has applied DL models for Arabic sentence analysis. The authors of Elhassan et al ( 2023 ), used LSTM, a hybrid CNN-LSTM, and convolutional neural networks (CNNs) to predict Arabic sentiment analysis. Word2Vec and fastText were employed as word embeddings.…”