A Global Optimization Approach to Multi-Polarity Sentiment Analysis

Abstract

Following the rapid development of social media, sentiment analysis has become an important social media mining technique. The performance of automatic sentiment analysis primarily depends on feature selection and sentiment classification. While information gain (IG) and support vector machines (SVM) are two important techniques, few studies have optimized both approaches in sentiment analysis. The effectiveness of applying a global optimization approach to sentiment analysis remains unclear. We propose a global optimization-based sentiment analysis (PSOGO-Senti) approach to improve sentiment analysis with IG for feature selection and SVM as the learning engine. The PSOGO-Senti approach utilizes a particle swarm optimization algorithm to obtain a global optimal combination of feature dimensions and parameters in the SVM. We evaluate the PSOGO-Senti model on two datasets from different fields. The experimental results showed that the PSOGO-Senti model can improve binary and multi-polarity Chinese sentiment analysis. We compared the optimal feature subset selected by PSOGO-Senti with the features in the sentiment dictionary. The results of this comparison indicated that PSOGO-Senti can effectively remove redundant and noisy features and can select a domain-specific feature subset with a higher-explanatory power for a particular sentiment analysis task. The experimental results showed that the PSOGO-Senti approach is effective and robust for sentiment analysis tasks in different domains. By comparing the improvements of two-polarity, three-polarity and five-polarity sentiment analysis results, we found that the five-polarity sentiment analysis delivered the largest improvement. The improvement of the two-polarity sentiment analysis was the smallest. We conclude that the PSOGO-Senti achieves higher improvement for a more complicated sentiment analysis task. We also compared the results of PSOGO-Senti with those of the genetic algorithm (GA) and grid search method. From the results of this comparison, we found that PSOGO-Senti is more suitable for improving a difficult multi-polarity sentiment analysis problem.

Capturing the Patient’s Perspective: a Review of Advances in Natural Language Processing of Health-Related Text

“…This is primarily because such tools are designed for formal medical text only, and are incapable of understanding social media expressions. Unsurprisingly, SVMs have obtained the best performance for a long time and are still very difficult to beat in terms of performance [108,114,117,[134][135][136]. Very recently, deep neural-network-based models have been designed and employed for social media health text classification, with very promising results [137].…”

Hybrid optimization for feature selection in opinion mining

“…The direction of path can be adjusted according to the velocity of each particle based on its own flight experience and the experiences of its companions. The optimal regions of complex search spaces are mined based on this superior strategy through the interaction of individuals in a set of particles [23]. There are four steps within a process period in PSO.…”

Automatic Product Review Sentiment Analysis Using Vader and Feature Visulaization

“…They have compared this approach with NB and Maximum Entropy methods and found that their method gave higher accuracy (0.76) as compared to NB (0.67) and Maxent (0.76) when applied to movie review datasets. Abbasi et.al [9] attempted to do benchmarking of twitter sentiment analysis tools.20 tools were applied to 5 test beds like telecom, [19] tried global optimization approach to multipolarity sentiment analysis. They found that 3-class polarity classification resulted in much lower accuracies as compared to 2-class polarity classification.…”

“…They applied this approach to the products like laptops and restaurants from Semeval2014 datasets with precision and recall scores between 82 to 88% with restaurant dataset giving better scores than laptops. Particle swarm optimization algorithm named as PSOGO-senti was developed and applied by Xinmiao et.al[19] specially applied to Chinese sentiment analysis for binary and multi polarity sentiment classification. They found that this algorithm is capable of eliminating redundant and noisy features.…”