Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)

Abstract

We present a novel way to frame a discussion of changes in publication patterns that occur in a context of performance-based research funding systems (PRFSs). Adopting an approach derived from social epistemology, we foreground the dialectical nature of knowledge. This allows us to relate changes in publication patterns to PRFS and show the tensions that emerge between relatively diverse research fields with diverse publication practices and bibliometric indicators within PRFSs that reinforce a singular view of research goals. Specifically, we highlight that the employment of bibliometric indicators result in a fixed hierarchy among communication media that may be at odds with the goals within research fields subjected to PRFSs. These ideas are illustrated with an empirical analysis of changes in publication patterns within the field of educational research at the University of Gothenburg (GU; 2005-2014) in Sweden. We contrast the observed changes with implicit priorities in the national and institutional PRFS that operate in this context since 2009. Findings from bibliometric analysis indicate a move away from publication traditions that used to be characteristic of educational research: the growth in the number of journal articles is greater than that in the number of book chapters, while the number of reports is on a declining slope. In relation to PRFSs, we show that conclusive judgement on the desirability of the observed changes is hardly achievable. If one adopts the aims implicit in PRFS, research performance appears to be enhanced. If one sides with the views of many educational researchers, then some of the trends might be an indication of undesirable changes.

National bibliographic data for studies of social sciences and humanities: towards interoperability

“…Research from the perspective of book publishers is less common. Some work has been done on the consolidation and concentration of the publishing industry, both in international ITM Web of Conferences 33, 02002 (2020) ICTeSSH 2020 https://doi.org/10.1051/itmconf /20203302002 and national contexts [2,11,29,30]. Thus the ABP can be a data source that opens up research opportunities on less explored topics.…”

The Effective Trends and Driving Forces in The Future of Research Performance Evaluation Based on Scoping Review and Interview

“…However, some organizations may not use the performance indicators properly due to the policies of their country and the interests of some people, and this affects the correct evaluation of the research performance of individuals and the country M10. Too much emphasis on quantitative indicators such as the number of scienti c productions and citations can affect the strategy of publishing of the younger researchers (Cheung, 2008;Sīle & Vanderstraeten, 2019). Today, research outputs appear in various forms of articles, books, patents, knowledge-based companies, presence on social networks, and so on.…”

National Lists of Scholarly Publication Channels: An Overview and Recommendations for Their Construction and Maintenance

“…In three Nordic countries, Denmark, Finland and Norway, bibliometric indicators representing research activities are part of the direct funding formula for the annual allocation of block-grant funding to universities (Sivertsen, 2017). Since 2009, Sweden applies an indicator based on WoS publications and citations for the same purpose (Sīle & Vanderstraeten, 2018). Instead, several Swedish institutions apply the "Norwegian list" for local purposes (Hammarfelt et al, 2016).…”