In this article we test whether metrics of online attention describing research can provide information on research quality and societal impact that is not found in citation data alone. Our approach is to set up a traditional model in which the true quality or impact of a university department is determined by a panel of experts, but a citation metric is regarded as a reasonable proxy. However, the model assumes that the information contained in the scores provided by an expert panel exceeds that contained in a citation metric (HEFCE, 2015). Finally, we extend this model by including altmetric data to see if it adds information about a department's performance that cannot be gleaned from citations alone. We find the presence of altmetric data for the cited underpinning research to be highly correlated with peer review scores for societal impact. Conversely, no such connection was seen with the assessment of research quality. Our findings therefore suggest altmetric data could be useful as an aid to assessing impact. Data SourcesThe analysis was restricted to main panel B of the submissions, which relates to mathematics, engineering, and the physical sciences (see Table 1). Within this subject grouping, 48,815 of the submitted 49,317 research outputs were journal articles, allowing a near complete mapping of bibliometric indicators to REF scores. The research activity in this panel is subdivided into nine separate topics; however, for the purpose of this work, three of the engineering units of assessments (UOAs) were combined, as they could all be labeled as "applied engineering." The creation of this agglomerated group meant that the number of submitted outputs across the subject areas were somewhat equalized
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.