Research output indicators are not productivity indicators

Ruiz‐Castillo, Javier

doi:10.1016/j.joi.2016.04.004

Cited by 6 publications

(3 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, this association implies neither a link with productivity-as in "Productivity is the quintessential indicator of efficiency in any production system" ( (Abramo & D'Angelo, 2014), p. 1129)-nor any input-output relationship. This relationship has been extensively discussed elsewhere Glanzel et al, 2016;Ruiz-Castillo, 2016;Waltman et al, 2016) but here we use efficiency in the sense of intrinsic efficiency or breakthrough potential, i.e., independent of inputs. This definition could be seen as the capacity of a research system to produce revolutionary science with the minimum possible amount of normal science, using Kuhn's terms (Kuhn, 1970).…”

Section: The Ep Index and Other Research Excellence Indicatorsmentioning

confidence: 99%

Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future

Rodríguez‐Navarro

Brito

2018

Journal of Informetrics

View full text Add to dashboard Cite

We have studied the efficiency of research in the EU by a percentile-based citation approach that analyzes the distribution of country papers among the world papers. Going up in the citation scale, the frequency of papers from efficient countries increases while the frequency from inefficient countries decreases. In the percentile-based approach, this trend, which is uniform at any citation level, is measured by the ep index that equals the Ptop 1%/Ptop 10% ratio. By using the ep index we demonstrate that EU research on fast-evolving technological topics is less efficient than the world average and that the EU is far from being able to compete with the most advanced countries. The ep index also shows that the USA is well ahead of the EU in both fast-and slowevolving technologies, which suggests that the advantage of the USA over the EU in innovation is due to low research efficiency in the EU. In accord with some previous studies, our results show that the European Commission's ongoing claims about the excellence of EU research are based on a wrong diagnosis. The EU must focus its research policy on the improvement of its inefficient research. Otherwise, the future of Europeans is at risk.

show abstract

Section: The Ep Index and Other Research Excellence Indicatorsmentioning

confidence: 99%

Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future

Rodríguez‐Navarro

Brito

2018

Journal of Informetrics

View full text Add to dashboard Cite

show abstract

“…This equation calculates a probability, which is size-independent. The usefulness of size-independent bibliometric indicators and of the application of terms such as productivity, performance, and efficiency in research evaluation have been debated (Abramo & D'Angelo, 2016a, 2016bGlänzel, Thijs, & Debackere, 2016;Ruiz-Castillo, 2016;Waltman, van Eck et al, 2016). That discussion is out of the scope of this study.…”

Section: Discussion About Size-independent Indicatorsmentioning

confidence: 94%

Total number of papers and in a single percentile fully describes research impact—Revisiting concepts and applications

Rodríguez‐Navarro

Brito

2021

Quantitative Science Studies

View full text Add to dashboard Cite

This study uses the thorough data provided by the Leiden Ranking 2020 to support the claim that percentile-based indicators are linked by a power law function. A constant calculated from this function, ℯp, and the total number of papers fully characterize the percentile distribution of publications. According to this distribution, the probability that a publication from a country or institution is in the global xth percentile can be calculated from a simple equation: P = ℯp(2 – lgx). By taking the Leiden Ranking PPtop10%/100 as an approximation of the ℯp constant, our results demonstrate that other PPtopx% indicators can be calculated applying this equation. Consequently, given a PPtopx% indicator, all the others are redundant with it. Even accepting that the total number of papers and a single PPtopx% indicator are sufficient to fully characterize the percentile distribution of papers, the results of comparisons between universities and research institutions differ depending on the percentile selected for the comparison. We discuss which Ptopx% and PPtopx% indicators are the most convenient for these comparisons in order to obtain reliable information that can be used in research policy.

show abstract

“…One of the subjects that we would like to put forward in future directions of the study is the efficiency and productivity measurement [53][54][55] of institutions within university. Since currently the number of employed academic staff/ /researchers at faculties and institutes is not visible in University of Belgrade' profile, it is not possible to provide a sound per researcher performance evaluation of faculties/institutes.…”

mentioning

confidence: 99%

Evaluating the scientific performance of institutions within the university: An example from the University of Belgrade leading institutions

Pilčević¹,

Jeremić²,

Vujošević

2018

JSCS

View full text Add to dashboard Cite

Numerous studies have evaluated the publication performance of universities worldwide, but studies examining intra-institutional performance still remain scarce. In this paper, as a case study, we provide an in-depth quantitative-qualitative analysis of University of Belgrade (UB) leading institutions performance. The results show that the UB scientific institutes, faculties of sciences and mathematics, together with the Faculty of Medicine and several faculties of technology and engineering sciences exhibit excellent scientific results. The Faculty of Medicine and Institute Vinča lead the way in terms of number of published papers, while Institute of Physics excels when taking into account the quality of journals. Results pointed out that the Faculty of Technology and Metallurgy, besides the number of papers, has a strong showing in terms of citation metrics. In addition, using a network graph we present collaboration patterns within the UB. This analysis may be a step in the right direction towards a model for evaluating and ranking institutions within a particular university.

show abstract

Research output indicators are not productivity indicators

Cited by 6 publications

References 11 publications

Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future

Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future

Total number of papers and in a single percentile fully describes research impact—Revisiting concepts and applications

Evaluating the scientific performance of institutions within the university: An example from the University of Belgrade leading institutions

Contact Info

Product

Resources

About