Scholarly impact assessment: a survey of citation weighting solutions

Cai, Liwei; Tian, Jiahao; Liu, Jiaying; Bai, Xiaomei; Lee, Ivan; Kong, Xiangjie; Xia, Feng

doi:10.1007/s11192-018-2973-6

Cited by 42 publications

(19 citation statements)

References 93 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…. , n) of each paper is drawn from positively skewed distribution over the interval [1,10], which is implemented by gamma function.…”

Section: Modeling Of Submission Processmentioning

confidence: 99%

“…Academic impact assessment and scientific journal ranking have always been a hot topic, which plays a very key role in the process of dissemination and development of academic research [1][2][3]. As one of the most important evaluation indicators in SCI, journal impact factor (JIF) is calculated by the scientific division of Clarivate Analytics ® and commonly used to rank and evaluate the grades of various scientific journals in the Journal Citation Report ® (JCR) database [4].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Modeling and Simulation Analysis of Journal Impact Factor Dynamics Based on Submission and Citation Rules

et al. 2020

View full text Add to dashboard Cite

The variation of the journal impact factor is affected by many statistical and sociological factors such as the size of citation window and subject difference. In this work, we develop an impact factor dynamics model based on the parallel system, which can be used to analyze the correlation between the impact factor and certain elements. The parallel model aims to simulate the submission and citation behaviors of the papers in journals belonging to a similar subject, in a distributed manner. We perform Monte Carlo simulations to show how the model parameters influence the impact factor dynamics. Through extensive simulations, we reveal the important role that certain statistics elements and behaviors play to affect impact factors. The experimental results and analysis on actual data demonstrate that the value of the JIF is comprehensively influenced by the average review time, average number of references, and aging distribution of citation.

show abstract

“…. , n) of each paper is drawn from positively skewed distribution over the interval [1,10], which is implemented by gamma function.…”

Section: Modeling Of Submission Processmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Modeling and Simulation Analysis of Journal Impact Factor Dynamics Based on Submission and Citation Rules

et al. 2020

View full text Add to dashboard Cite

show abstract

“…In the past, more attention has been given to explicit success factors. In author impact evaluation research, researchers have found some explicit success factors such as academic age, institution, research field, and country [110]. However, little is known about the mechanisms of the temporal evolution of success in science.…”

Section: Implicit Success Factor Miningmentioning

confidence: 99%

Quantifying Success in Science: An Overview

et al. 2020

Self Cite

View full text Add to dashboard Cite

Quantifying success in science plays a key role in guiding funding allocations, recruitment decisions, and rewards. Recently, a significant amount of progresses have been made towards quantifying success in science. This lack of detailed analysis and summary continues a practical issue. The literature reports the factors influencing scholarly impact and evaluation methods and indices aimed at overcoming this crucial weakness. We focus on categorizing and reviewing the current development on evaluation indices of scholarly impact, including paper impact, scholar impact, and journal impact. Besides, we summarize the issues of existing evaluation methods and indices, investigate the open issues and challenges, and provide possible solutions, including the pattern of collaboration impact, unified evaluation standards, implicit success factor mining, dynamic academic network embedding, and scholarly impact inflation. This paper should help the researchers obtaining a broader understanding of quantifying success in science, and identifying some potential research directions.INDEX TERMS success in science, scholarly impact, evaluation indices.

show abstract

“…Hence, the scholarly impact can be measured by citations that a publication receives. Scholars also generally agree that it is reasonable to use weighted citations to assess the scholarly impact (Cai et al , 2019). Citation analysis has become an indispensable component of research evaluation methodology and has established itself given its specialty and preciseness (Yang and Han, 2015).…”

Section: Related Studiesmentioning

confidence: 99%

Do proceedings papers in science fields have higher impacts than those in the field of social science and humanities?

Yang

2020

LHT

View full text Add to dashboard Cite

PurposeThis study aims to compare the impacts of proceedings papers in the fields of social science and humanities (SSH) and science.Design/methodology/approachThis study involved not only citations but also altmetric indexes to compare the impacts of proceedings papers among multiple disciplines with 1,779,166 records from Conference Proceedings Citation Index (CPCI) in the Web of Science (WoS) in the period of 2013–2017. The mean value, concentration ratio, Lorenz curves and correlation analysis are utilized into the comparative analysis.Findings(1) Proceedings papers in science fields had higher scholarly impacts than those in SSH fields. (2) As for societal impact, clinical, pre-clinical and health still ranked first, whereas physical science and engineering and technologies were transcended by SSH fields, which is different from the scholarly impact of proceedings papers. (3) As for proceedings papers, citations and altmetric indexes have weak or moderate correlations in all six fields, indicating that altmetrics can be supplemented when assessing proceedings papers.Originality/valueThis study is expected to enhance the understanding of proceedings papers and to promote accuracy of evaluation for them by exhibiting the multidisciplinary differences of their scholarly and societal impacts.

show abstract

Scholarly impact assessment: a survey of citation weighting solutions

Cited by 42 publications

References 93 publications

Modeling and Simulation Analysis of Journal Impact Factor Dynamics Based on Submission and Citation Rules

Modeling and Simulation Analysis of Journal Impact Factor Dynamics Based on Submission and Citation Rules

Quantifying Success in Science: An Overview

Do proceedings papers in science fields have higher impacts than those in the field of social science and humanities?

Contact Info

Product

Resources

About