This paper investigates three morphosyntactic alternations in Estonian – those between the exterior locative cases allative, adessive and ablative and the corresponding postpositions peale ‘onto’, peal ‘on’ and pealt ‘off’. Based on the Complexity Principle (e.g., Rohdenburg, Günter. 2002. Processing complexity and the variable use of prepositions in English. In Hubert Cuyckens & Günter Radden (eds.), Perspectives on prepositions, 79–100. Tübingen: Niemeyer), we expect cognitively more complex constructions to use more explicit (i.e., morphologically more substantial) marking by means of a postposition. Further, we expect variation to be conditioned similarly in all three semantic categories. For each of the three alternations, a random sample of the two outcomes (case vs. postposition) from the Estonian National Corpus is used, resulting in 3,000 data points. Using properties of the Landmark phrase as independent variables in Bayesian mixed-effects logistic regression models, we predict the choice of postpositions over case-marked realisations. Of the patterns found, only the frequency-related one supports our complexity-related hypothesis. We conclude that the Complexity Principle, in its general form, has little explanatory power for the Estonian constructions at hand and, in particular, that the derived principle of ‘analytic support’ is not generally applicable. We show, however, that the grammatical knowledge of Estonian exterior locative cases and the corresponding postpositions is regulated by our three factors in a relatively uniform way.