New Clustering Algorithms for Twitter Sentiment Analysis

Rehioui, Hajar; Idrissi, Abdellah

doi:10.1109/jsyst.2019.2912759

Cited by 45 publications

(24 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For the tweet data clustering (Sechelea et al 2016 ); (Rehioui and Idrissi 2019 ), topic models (Amelio and Pizzuti 2015 ; Xu et al 2019 ; Hu et al 2012 ; Ismail et al 2018 ) are required for modelling the tweets with respect to topics instead of terms for avoiding the problem of data sparsity. Topic models, i.e.…”

Section: Related Visual Methodsmentioning

confidence: 99%

An effective assessment of cluster tendency through sampling based multi-viewpoints visual method

Prasad¹,

Reddy

Mohammed

2021

J Ambient Intell Human Comput

View full text Add to dashboard Cite

Section: Related Visual Methodsmentioning

confidence: 99%

An effective assessment of cluster tendency through sampling based multi-viewpoints visual method

Prasad¹,

Reddy

Mohammed

2021

J Ambient Intell Human Comput

View full text Add to dashboard Cite

“…of clusters, and evaluation metrics. Though main aim of unsupervised clustering approach is to find the hidden patterns among dataset, it is being widely used for the classification of unlabelled corpus [9], [10], [13], [16], [18], [22], [24], [26], [34].…”

Section: Literature Reviewmentioning

confidence: 99%

“…Reference [26], more recently presented a combination of two clustering approach that is K-mean and DENCLUE for twitter sentiment analysis. They observed that a combination of those two algorithms provided effective results than the state-of-the-art methods (e.g., DBSCAN, K-mean) in terms of clustering performance, run time and no.…”

Section: Literature Reviewmentioning

confidence: 99%

See 1 more Smart Citation

Real-Time Twitter Corpus Labelling Using Automatic Clustering Approach

Gupta¹,

Joshi²

2021

IJCDS

View full text Add to dashboard Cite

“…Machine learning-based clustering algorithms are broken into five types: partitioning, hierarchical, density-based, grid-based, and model-based clustering algorithms (Rehioui & Idrissi, 2019). After preprocessing and feature extraction, the data are split into 90%-10%; where the 90% part is used to train the machine learning model, and thus referred to as the training phase (Ranjit et al, 2018).…”

Section: Data Miningmentioning

confidence: 99%

Machine Learning-based Flu Forecasting Study Using the Official Data from the Centers for Disease Control and Prevention and Twitter Data

Wahid

Munkeby²,

Sambasivam

2021

IISIT

View full text Add to dashboard Cite

Aim/Purpose: In the United States, the Centers for Disease Control and Prevention (CDC) tracks the disease activity using data collected from medical practice's on a weekly basis. Collection of data by CDC from medical practices on a weekly basis leads to a lag time of approximately 2 weeks before any viable action can be planned. The 2-week delay problem was addressed in the study by creating machine learning models to predict flu outbreak. Background: The 2-week delay problem was addressed in the study by correlation of the flu trends identified from Twitter data and official flu data from the Centers for Disease Control and Prevention (CDC) in combination with creating a machine learning model using both data sources to predict flu outbreak. Methodology: A quantitative correlational study was performed using a quasi-experimental design. Flu trends from the CDC portal and tweets with mention of flu and influenza from the state of Georgia were used over a period of 22 weeks from December 29, 2019 to May 30, 2020 for this study. Contribution: This research contributed to the body of knowledge by using a simple bag-of-word method for sentiment analysis followed by the combination of CDC and Twitter data to generate a flu prediction model with higher accuracy than using CDC data only. Findings: The study found that (a) there is no correlation between official flu data from CDC and tweets with mention of flu and (b) there is an improvement in the performance of a flu forecasting model based on a machine learning algorithm using both official flu data from CDC and tweets with mention of flu. Recommendations for Practitioners: In this study, it was found that there was no correlation between the official flu data from the CDC and the count of tweets with mention of flu, which is why tweets alone should be used with caution to predict a flu out-break. Based on the findings of this study, social media data can be used as an additional variable to improve the accuracy of flu prediction models. It is also found that fourth order polynomial and support vector regression models offered the best accuracy of flu prediction models. Recommendations for Researchers: Open-source data, such as Twitter feed, can be mined for useful intelligence benefiting society. Machine learning-based prediction models can be improved by adding open-source data to the primary data set. Impact on Society: Key implication of this study for practitioners in the field were to use social media postings to identify neighborhoods and geographic locations affected by seasonal outbreak, such as influenza, which would help reduce the spread of the disease and ultimately lead to containment. Based on the findings of this study, social media data will help health authorities in detecting seasonal outbreaks earlier than just using official CDC channels of disease and illness reporting from physicians and labs thus, empowering health officials to plan their responses swiftly and allocate their resources optimally for the most affected areas. Future Research: A future researcher could use more complex deep learning algorithms, such as Artificial Neural Networks and Recurrent Neural Networks, to evaluate the accuracy of flu outbreak prediction models as compared to the regression models used in this study. A future researcher could apply other sentiment analysis techniques, such as natural language processing and deep learning techniques, to identify context-sensitive emotion, concept extraction, and sarcasm detection for the identification of self-reporting flu tweets. A future researcher could expand the scope by continuously collecting tweets on a public cloud and applying big data applications, such as Hadoop and MapReduce, to perform predictions using several months of historical data or even years for a larger geographical area.

show abstract

New Clustering Algorithms for Twitter Sentiment Analysis

Cited by 45 publications

References 17 publications

An effective assessment of cluster tendency through sampling based multi-viewpoints visual method

An effective assessment of cluster tendency through sampling based multi-viewpoints visual method

Real-Time Twitter Corpus Labelling Using Automatic Clustering Approach

Machine Learning-based Flu Forecasting Study Using the Official Data from the Centers for Disease Control and Prevention and Twitter Data

Contact Info

Product

Resources

About