A construction and empirical research of the journal disruption index based on open citation data

Jiang, Yuyan; Liu, Xueli

doi:10.1007/s11192-023-04737-y

Cited by 6 publications

(2 citation statements)

References 52 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These indicators encompass the quality of impacts, productivity, and structural aspects. As previously stated, a suitable source was employed for the purpose of retrieving patents and scientific articles [ 19 , 20 ]. The time frame considered for this search extended from January 2010 to December 2023.…”

Section: Methodsmentioning

confidence: 99%

Overview of Research on Leishmaniasis in Africa: Current Status, Diagnosis, Therapeutics, and Recent Advances Using By-Products of the Sargassaceae Family

Abdoul-Latif,

Oumaskour,

Abdallah

et al. 2024

Pharmaceuticals

View full text Add to dashboard Cite

Leishmaniasis in Africa, which has been designated as a priority neglected tropical disease by various global organizations, exerts its impact on millions of individuals, primarily concentrated within this particular region of the world. As a result of the progressively grave epidemiological data, numerous governmental sectors and civil organizations have concentrated their endeavors on this widespread outbreak with the objective of devising appropriate remedies. This comprehensive examination delves into multiple facets of this parasitic ailment, scrutinizing the associated perils, diagnostic intricacies, and deficiencies within the existing therapeutic protocols. Despite the established efficacy of current treatments, they are not immune to deleterious incidents, particularly concerning toxicity and the emergence of parasitic resistance, thus accentuating the necessity of exploring alternative avenues. Consequently, this research not only encompasses conventional therapeutic approaches, but also extends its scope to encompass complementary and alternative medicinal techniques, thereby striving to identify innovative solutions. A particularly auspicious dimension of this study lies in the exploration of natural substances and by-products derived from some brown algae of the Sargassaceae family. These resources possess the potential to assume a pivotal role in the management of leishmaniasis.

show abstract

Section: Methodsmentioning

confidence: 99%

Overview of Research on Leishmaniasis in Africa: Current Status, Diagnosis, Therapeutics, and Recent Advances Using By-Products of the Sargassaceae Family

Abdoul-Latif,

Oumaskour,

Abdallah

et al. 2024

Pharmaceuticals

View full text Add to dashboard Cite

show abstract

“…This series of studies has made it possible to evaluate the disruption of research papers based on the D index, which has gradually matured. On this basis, Jiang and Liu [ 44 ] proposed the Journal Disruption Index (JDI) to evaluate the disruptive innovation level of journals (as in Equation 3) and validated the evaluation effect of this indicator based on Chinese SCIE journals [ 45 ].…”

Section: Methodsmentioning

confidence: 99%

Evaluation and Comparison of Academic Impact and Disruptive Innovation Level of Medical Journals: Bibliometric Analysis and Disruptive Evaluation

Jiang,

Liu,

Zhang

et al. 2024

J Med Internet Res

Self Cite

View full text Add to dashboard Cite

Background As an important platform for researchers to present their academic findings, medical journals have a close relationship between their evaluation orientation and the value orientation of their published research results. However, the differences between the academic impact and level of disruptive innovation of medical journals have not been examined by any study yet. Objective This study aims to compare the relationships and differences between the academic impact, disruptive innovation levels, and peer review results of medical journals and published research papers. We also analyzed the similarities and differences in the impact evaluations, disruptive innovations, and peer reviews for different types of medical research papers and the underlying reasons. Methods The general and internal medicine Science Citation Index Expanded (SCIE) journals in 2018 were chosen as the study object to explore the differences in the academic impact and level of disruptive innovation of medical journals based on the OpenCitations Index of PubMed open PMID-to-PMID citations (POCI) and H1Connect databases, respectively, and we compared them with the results of peer review. Results First, the correlation coefficients of the Journal Disruption Index (JDI) with the Journal Cumulative Citation for 5 years (JCC5), Journal Impact Factor (JIF), and Journal Citation Indicator (JCI) were 0.677, 0.585, and 0.621, respectively. The correlation coefficient of the absolute disruption index (Dz) with the Cumulative Citation for 5 years (CC5) was 0.635. However, the average difference in the disruptive innovation and academic influence rankings of journals reached 20 places (about 17.5%). The average difference in the disruptive innovation and influence rankings of research papers reached about 2700 places (about 17.7%). The differences reflect the essential difference between the two evaluation systems. Second, the top 7 journals selected based on JDI, JCC5, JIF, and JCI were the same, and all of them were H-journals. Although 8 (8/15, 53%), 96 (96/150, 64%), and 880 (880/1500, 58.67%) of the top 0.1%, top 1%, and top 10% papers selected based on Dz and CC5, respectively, were the same. Third, research papers with the “changes clinical practice” tag showed only moderate innovation (4.96) and impact (241.67) levels but had high levels of peer-reviewed recognition (6.00) and attention (2.83). Conclusions The results of the study show that research evaluation based on innovative indicators is detached from the traditional impact evaluation system. The 3 evaluation systems (impact evaluation, disruptive innovation evaluation, and peer review) only have high consistency for authoritative journals and top papers. Neither a single impact indicator nor an innovative indicator can directly reflect the impact of medical research for clinical practice. How to establish an integrated, comprehensive, scientific, and reasonable journal evaluation system to improve the existing evaluation system of medical journals still needs further research.

show abstract

What do we know about the disruption index in scientometrics? An overview of the literature

Leibel,

Bornmann

2023

Scientometrics

View full text Add to dashboard Cite

The purpose of this paper is to provide a review of the literature on the original disruption index (DI1) and its variants in scientometrics. The DI1 has received much media attention and prompted a public debate about science policy implications, since a study published in Nature found that papers in all disciplines and patents are becoming less disruptive over time. This review explains in the first part the DI1 and its variants in detail by examining their technical and theoretical properties. The remaining parts of the review are devoted to studies that examine the validity and the limitations of the indices. Particular focus is placed on (1) possible biases that affect disruption indices (2) the convergent and predictive validity of disruption scores, and (3) the comparative performance of the DI1 and its variants. The review shows that, while the literature on convergent validity is not entirely conclusive, it is clear that some modified index variants, in particular DI5, show higher degrees of convergent validity than DI1. The literature draws attention to the fact that (some) disruption indices suffer from inconsistency, time-sensitive biases, and several data-induced biases. The limitations of disruption indices are highlighted and best practice guidelines are provided. The review encourages users of the index to inform about the variety of DI1 variants and to apply the most appropriate variant. More research on the validity of disruption scores as well as a more precise understanding of disruption as a theoretical construct is needed before the indices can be used in the research evaluation practice.

show abstract

A construction and empirical research of the journal disruption index based on open citation data

Cited by 6 publications

References 52 publications

Overview of Research on Leishmaniasis in Africa: Current Status, Diagnosis, Therapeutics, and Recent Advances Using By-Products of the Sargassaceae Family

Overview of Research on Leishmaniasis in Africa: Current Status, Diagnosis, Therapeutics, and Recent Advances Using By-Products of the Sargassaceae Family

Evaluation and Comparison of Academic Impact and Disruptive Innovation Level of Medical Journals: Bibliometric Analysis and Disruptive Evaluation

What do we know about the disruption index in scientometrics? An overview of the literature

Contact Info

Product

Resources

About