Meta‐Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences

Abstract

Introduction. In recent years, several controversial reports of the correlation between altmetric score and citations have been published (range: -0.2 to 0.8). We conducted a meta-analysis to provide an in-depth statistical analysis of the correlation between altmetric score and number of citations in the field of health sciences. Methods. Three online databases (Web of Science, Scopus, and PubMed) were systematically searched, without language restrictions, from the earliest publication date available through February 29, 2020, using the keywords “altmetric,” “citation,” and “correlation.” Grey literature was also searched via WorldCat, Open Grey, and Google Scholar (first 100 hits only). All studies in the field of health sciences that reported on this correlation were included. Effect sizes were calculated using Fisher’s z transformation of correlations. Subgroup analyses based on citation source and sampling methods were performed. Results. From 27 included articles, 8 articles comprise several independent studies. The total sample size was 9,943 articles comprised of 35 studies. The overall pooled effect size was 0.19 (95% confidence interval 0.13 to 0.26). Bivariate partial prediction of interaction between effect size, citation source, and sampling method showed a greater effect size with Web of Science compared with Scopus and Dimensions. Egger’s regression showed a marginally nonsignificant publication bias ( p = 0.055 ), and trim-and-fill analysis estimated one missing study in this meta-analysis. Conclusion. In health sciences, currently altmetric score has a positive but weak correlation with number of citations ( pooled correlation = 0.19 , 95% C.I 0.12 to 0.25). We emphasize on future examinations to assess changes of correlation pattern between altmetric score and citations over time.

The top 100 most impactful articles on the anterior cruciate ligament: An altmetric analysis of online media

“…Citation rate has been shown to have no correlation to AAS, 123 supported in our study by the incongruence in the article topics and types that constitute to the most impactful articles as determined by AAS or citation rate. Compared with previous studies that examined the most impactful ACL articles by citation density, 18 , 124 the results of the present study demonstrate a predominance of clinically focused studies and a relatively lower degree of interest in laboratory studies.…”

Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?

“…To our knowledge, this is the first analysis to investigate the relationship between altmetric influence and subsequent academic citation using a modern, adjusted citation impact factor rather than raw citation count. In our sample of clinical and translational research, we found a stronger correlation between the AAS and citations than did a recent meta‐analysis examining this relationship across many fields 8 . This suggests that research focused on translation, which specifically aims to advance discoveries from the bench to the bedside, may benefit more from dissemination through public and community attention.…”

“…In our sample of clinical and translational research, we found a stronger correlation between the AAS and citations than did a recent meta‐analysis examining this relationship across many fields. 8 This suggests that research focused on translation, which specifically aims to advance discoveries from the bench to the bedside, may benefit more from dissemination through public and community attention. Further, we found that the AAS was more strongly related to the RCR than to total citations in this dataset.…”

“…Articles that elicit early nonacademic attention may be more likely to be noticed by other researchers, which could increase the likelihood that the research will be applied and cited in subsequent research. Indeed, past research in numerous fields has investigated the relationship between altmetric scores and citation counts and found little to no association 6–10 . However, no previous research has focused on this relationship in clinical/translational research, which aims to advance discoveries across boundaries from basic science to public use.…”

“…Indeed, past research in numerous fields has investigated the relationship between altmetric scores and citation counts and found little to no association. 6 , 7 , 8 , 9 , 10 However, no previous research has focused on this relationship in clinical/translational research, which aims to advance discoveries across boundaries from basic science to public use. Dissemination across academic silos and across phases of the translational spectrum is expected to facilitate the interdisciplinary cross‐pollination that is key to translational goals.…”