Evaluations as value-measurement links: Exploring metrics and meanings in science

Abstract

This contribution seeks to provide a more detailed insight into the entanglement of value and measurement. Drawing on insights from semiotics and a Bourdieusian perspective on language as an economy of linguistic exchange, we develop the theoretical concept of value-measurement links and distinguish three processes – operationalisation, nomination, and indetermination – as forms in which these links can be constructed. We illustrate these three processes using (e)valuation practices in science, particularly the journal impact factor, as an empirical object of investigation. As this example illustrates, measured values can function as building blocks for further measurements, and thus establish chains of evaluations, where it becomes more and more obscure which values the measurements actually express. We conclude that in the case of measured values such as impact factors, these chains are driven by the interplay between the interpretative openness of language and the seeming tendency of numbers to fixate meaning thus continually re-creating, transforming and modifying values.

How journalists do memory work with numbers: The case of the 220,000 deaths during the Colombian conflict (1958–2012)

“…The messy and open-ended reality is labelled by specific definitions, organised into man-made categories and analysed according to sets of rules within statistics or data analysis. The resulting data often reflects these different decisions more than the specific reality that is trying to be represented (Glasman, 2020;Hesselmann and Schendzielorz, 2019;Louikissas, 2019;Merry, 2016;Randall et al, 2011).…”