Public Reaction to Scientific Research via Twitter Sentiment Prediction

Abstract

Purpose Social media users share their ideas, thoughts, and emotions with other users. However, it is not clear how online users would respond to new research outcomes. This study aims to predict the nature of the emotions expressed by Twitter users toward scientific publications. Additionally, we investigate what features of the research articles help in such prediction. Identifying the sentiments of research articles on social media will help scientists gauge a new societal impact of their research articles. Design/methodology/approach Several tools are used for sentiment analysis, so we applied five sentiment analysis tools to check which are suitable for capturing a tweet's sentiment value and decided to use NLTK VADER and TextBlob. We segregated the sentiment value into negative, positive, and neutral. We measure the mean and median of tweets’ sentiment value for research articles with more than one tweet. We next built machine learning models to predict the sentiments of tweets related to scientific publications and investigated the essential features that controlled the prediction models. Findings We found that the most important feature in all the models was the sentiment of the research article title followed by the author count. We observed that the tree-based models performed better than other classification models, with Random Forest achieving 89% accuracy for binary classification and 73% accuracy for three-label classification. Research limitations In this research, we used state-of-the-art sentiment analysis libraries. However, these libraries might vary at times in their sentiment prediction behavior. Tweet sentiment may be influenced by a multitude of circumstances and is not always immediately tied to the paper's details. In the future, we intend to broaden the scope of our research by employing word2vec models. Practical implications Many studies have focused on understanding the impact of science on scientists or how science communicators can improve their outcomes. Research in this area has relied on fewer and more limited measures, such as citations and user studies with small datasets. There is currently a critical need to find novel methods to quantify and evaluate the broader impact of research. This study will help scientists better comprehend the emotional impact of their work. Additionally, the value of understanding the public's interest and reactions helps science communicators identify effective ways to engage with the public and build positive connections between scientific communities and the public. Originality/value This study will extend work on public engagement with science, sociology of science, and computational social science. It will enable researchers to identify areas in which there is a gap between public and expert understanding and provide strategies by which this gap can be bridged.

YouTube and science: models for research impact

“…On this point, according to Weller et al ( 2015 ), the proper use of altmetrics can help disseminate new scientific innovations to the public. Researchers have recently employed social media metrics to gauge public reaction to scientific findings (Freeman et al, 2019 , 2020 ; Shahzad & Alhoori, 2022 ; Shahzad et al, 2022 ).…”

Quantifying the online long-term interest in research

“…The number of research articles shared on these platforms is estimated to be increasing at a rate of 5-10% per month (Adie and Roe, 2013). In general, these platforms enable researchers to stay current on developments in their fields, as well as share and discuss their research data and findings, as well as solicit early feedback (Shahzad and Alhoori, 2022). Researchers include links to these news stories on their websites as evidence of their work's social impact.…”

Sentiment Analysis of Twitter Feeds Using Flask Environment: A Superior Application of Data Analysis

“…Shahzad et al [ 20 ] aim to forecast the nature of Twitter users' reactions to scientific papers along with looking into what characteristics of research articles aid in such prediction. Scientists will be able to measure a new societal influence of their research articles by analyzing the attitudes of research articles on social media.…”