Do altmetrics correlate with citations? A study based on the 1,000 most-cited articles

Abstract

Purpose The purpose of this paper is to study the presence of highly cited papers of Nature in social media websites and tools. It also tries to examine the correlation between altmetric and bibliometric indicators. Design/methodology/approach This descriptive study was carried out using altmetric indicators. The research sample consisted of 1,000 most-cited articles in Nature. In February 2019, the bibliographic information of these articles was extracted from the Scopus database. Then, the titles of all articles were manually searched on Google, and by referring to the article in the journal website and altmetric institution, the data related to social media presence and altmetric score of articles were collected. The data were analyzed using Microsoft Excel and SPSS. Findings According to the results of the study, from 1,000 articles, 989 of them (98.9 per cent) were mentioned at least once in different social media websites and tools. The most used altmetric source in highly cited articles was Mendeley (98.9 per cent), followed by Citeulike (79.8 per cent) and Wikipedia (69.4 per cent). Most Tweets, blog posts, Facebook posts, news stories, readers in Mendeley, Citeulike and Connotea and Wikipedia citations belonged to the article titled “Mastering the game of Go with deep neural networks and tree search”. The highest altmetric score was 3,135 which belonged to this paper. Most tweeters and articles’ readers were from the USA. The membership type of the tweeters was public membership. In terms of fields of study, most readers were PhD students in Agricultural and Biological Sciences. Finally, the results of Spearman’s Correlation revealed positive significant statistical correlation between all altmetric indicators and received citations of highly cited articles (p-value = 0.0001). Practical implications The results of this study can help researchers, editors and editorial boards of journals better understand the importance and benefits of using social media and tools to publish articles. Originality/value Altmetrics is a relatively new field, and in particular, there are not many studies related to the presence of articles in various social media until now. Accordingly, in this study, a comprehensive altmetric analysis was carried out on 1000 most-cited articles of one of the world's most reliable journals.

Six Sigma in Health Literature, What Matters?

“…Research impact can be addressed using different metrics and can also be affected by various determinants. Although some previous research found a positive correlation between traditional metrics and altmetrics [20,39], others claim they are weakly correlated [24]. Our study has also constated that the items influencing both metrics are different [29].…”

“…They capture the relevance of research based on metrics such as article views, downloads, and mentions on social media or news media [16], considering channels such as Twitter, Mendeley, CitedULike or blogging [18,19], among others. Given the growth and relevance of social media for sharing scientific knowledge [20], these novel metrics have become necessary and represent another way to assess research impact.…”

Correlation between the Altmetrics Attention Score (AAS) and the Citation Count (CC): A study based on highly cited breast cancer articles

“…To date, various statistical analyses have been used to measure the correlation between citation count and the Altmetrics Attention Score. Among those statistical analyses, Costas et al, 2015;Huang, Wang, & Wu, 2018;and Ouchi, Saberi, Ansari, Hashempour, & Isfandyari-Moghaddam, 2019 have used Spearman's rank order correlation coefficient to measure the correlation between citation count and the Altmetrics Attention Score. Spearman's rank order correlation coefficient is a non-parametric statistical test that measures "the strength and direction of association that exists between two variables measured on at least an ordinal scale" (Laerd Statistics, 2018b).…”

Research evaluation of computer science publications using Altmetrics: a cohort study of Indian Central Universities

“…They identified that AAS poorly correlated with citations and the correlation strength did not change on subgroup analyses of individual journal, study type, or the individual score components. Ouchi et al (2019) explored "the correlation between Altmetric and bibliometric indicators for 1000 most-cited articles in Nature. A positive significant correlation was found between the Altmetric indicators and citations".…”