Ranking resilience: assessing the impact of scientific performance and the expansion of the Times Higher Education Word University rankings on the position of Czech, Hungarian, Polish, and Slovak universities

Abstract

University rankings are gaining importance worldwide. While the top-ranked universities are the subject of numerous academic publications, very little literature is available on universities in the lower two-thirds of the ranking list. In this study, we analysed the sensitivity of year to year changes in position in the Times Higher Education World University Rankings (THE) of universities from the Czech Republic, Hungary, Poland, and Slovakia using hypothetical scenarios of potential changes in their research outputs. A regression model was developed that quantifies the effect of the inclusion of institutions that are new to ranking as well as dropouts on the ranking list. We also developed a method to allow customized sensitivity analysis of the subsequent year's rank from an institution's projected research output, given its current rank and research output, assuming that other ranking indicators remain unchanged over 1–2 years. It should be noted that universities in the region have ranked below 800, and while research output has been increasing, it was observed that ranks worsen for most universities from these four countries. The field-weighted citation index and the total volume of publications had the highest effect on rankings, while the proportion of Scimago Q1 publications did not have a consistent effect on the projected next year's ranks. In most universities, the growth in research performance indicators were below the level that would be required to offset the rank changes due to the inclusion of new entrants in ranking. The findings of this research suggest that universities have to consider complex strategies to improve their ranking focusing on other activities than research such as reputation, internationalization, or industry income. With due caution, our results might be generalized to most of the universities below 800 in the THE. The rank prediction tool presented in this article is available online at https://hecon.uni-obuda.hu/en/rank-calculator/. JEL code I21, I23, I28