Research on the impact evaluation of academic journals based on altmetrics and citation indicators

Abstract

Taking international LIS journals as an example, combining 8 traditional citation indicators and 10 altmetrics indicators, we use the method of multi‐indicator fusion to construct a comprehensive evaluation model of journal impact based on traditional citation indicators and altmetrics indicators. Through normalization processing, correlation analysis, reliability analysis, validity analysis, factor analysis, the paper evaluates the academic impact (FA), societal impact (FS) of LIS journals respectively. We get the following conclusion: (1) We get the 2‐dimensional evaluation results and according to LIS journals impacts, we divide the roles into four categories: “Prestige journals”, “Star journals”, “Common journals” and “Expert journals”. (2) It is found that 8 traditional citation indicators based on JCR, present strong positive correlations, and the indicators are highly consistent overall and internally. (3) There are moderate or high positive correlations among 10 altmetrics based on Altmetrics Explorer, and there are also significant consistency among the indicators as a whole and internally. (4) The correlation coefficient between FA and FS is 0.566, with a moderate positive correlation. It indicates that the evaluation of LIS journals' societal impact based on altmetrics indicators has a useful supplement to the evaluation of academic impact based on citation.

Quality and integrity of the data used for the measurement of scientific output. Study Case: CvLAC Platform (Colombia)

“…Sin embargo, una de las características en común entre los cosechadores es la recuperación de los metadatos, esto corresponde a información de trabajos, autores y entidades, permitiendo hacer búsquedas especializadas por identificadores que estén indexados sobre el recurso. Así mismo, el registro del contenido, por el cual las agencias permiten la serialización de un recurso digital para ser identificado a través de la red, ejemplo de esto es el DOI, que es registrado por la agencia para ser usado al momento de la publicación de un trabajo en una revista y así tener una trazabilidad a través de las citaciones en artículos, mención en redes sociales y aparición en blogs [10].…”

Characteristics analysis and evaluation of discourse leading for academic journals: perspectives from multiple integration of altmetrics indicators and evaluation methods

“…Secondly, in terms of the use of evaluation methods, some scholars used social network analysis, factor analysis, two-dimensional analysis and three-dimensional analysis methods to conduct comprehensive evaluations of academic journals' influence from the perspective of multi-dimensional and multi-indicator integration (Zhao and Wang, 2018, 2019a). Zhao and Wang (2018, 2019b) used correlation analysis, reliability/validity analysis, factor analysis and two-dimensional analysis to evaluate and compare the academic influence and social influence of international OA journals in China and USA. Unutmaz Durmuşoğlu and Durmuşoğlu (2021) used the TOPSIS method to propose a model that provides effective decision-making for authors to select contributing journals.…”

“…, 2018). Altmetrics has many new features in academic journal evaluation and is used by scholars to compare with traditional bibliometric indicators (Wang and Zhao, 2021) and to construct a multi-dimensional evaluation model of multiple evaluation information (Liao, 2015; Zhao et al. , 2019a, b).…”

“…Altmetrics has many new features in academic journal evaluation and is used by scholars to compare with traditional bibliometric indicators (Wang and Zhao, 2021) and to construct a multi-dimensional evaluation model of multiple evaluation information (Liao, 2015; Zhao et al. , 2019a, b). For example, in the case of insufficient citation data delay, altmetrics data can be used for the journal front-end evaluation (Li et al.…”

Research on the relationships between discourse leading indicators and citations: perspectives from altmetrics indicators of international multidisciplinary academic journals

“…In addition, science tweeters were more active when posting scientific achievements than when retweeting scientific achievements in some fields. Third, in recent years, researchers try to integrate traditional bibliometrics indicators and new altmetrics indicators to evaluate academic journals in multidimensional, multi-indicator and multi-method that also appear sporadically (Zhao and Wang, 2019, 2020; Zhao et al. , 2019; Wang, 2019; Li et al.…”