Measuring precision precisely: A dictionary-based measure of imprecision

Abstract

How can we measure and explain the precision of international organizations’ (IOs) founding treaties? We define precision by its negative – imprecision – as indeterminate language that intentionally leaves a wide margin of interpretation for actors after agreements enter into force. Compiling a “dictionary of imprecision” from almost 500 scholarly contributions and leveraging insight from linguists that a single vague word renders the whole sentence vague, we introduce a dictionary-based measure of imprecision (DIMI) that is replicable, applicable to all written documents, and yields a continuous measure bound between zero and one. To demonstrate that DIMI usefully complements existing approaches and advances the study of (im-)precision, we apply it to a sample of 76 IOs. Our descriptive results show high face validity and closely track previous characterizations of these IOs. Finally, we explore patterns in the data, expecting that imprecision in IO treaties increases with the number of states, power asymmetries, and the delegation of authority, while it decreases with the pooling of authority. In a sample of major IOs, we find robust empirical support for the power asymmetries and delegation propositions. Overall, DIMI provides exciting new avenues to study precision in International Relations and beyond.

Concepts and measures of bureaucratic constraints in European Union laws from hand‐coding to machine‐learning

“…3 3 In comparative politics, Huber and Shipan (2002: 73) utilize the length of the legislative text as a proxy for control since “longer statutes on the same topic are more likely to tell agencies what to do, and shorter ones give them more leeway”. On a similar note, Citi and Jensen (2022) measure the levels of precision in legislative texts which limit the executive discretion of supranational authorities, while Gastinger and Schmidtke (2022) develop a dictionary‐based measure of imprecision as a proxy of discretion of international organizations. …”

Discovering cooperation: Endogenous change in international organizations

“… 7 The theoretical literature sometimes treats contractual incompleteness as a continuous phenomenon but in the absence of prior measures, we opt for a binary operationalization. A recent example of measuring the precision of treaty substance in continuous terms is Gastinger and Schmidtke ( 2022 ). …”