Our paper explores how a rule prescribed by the European Union can bring about changes in the policy discourse of a member state. Drawing on the literatures of discursive institutionalism and Europeanization, the theoretical part discusses the factors that influence discursive shifts. The empirical part examines the discursive impacts of the introduction of the structural budget deficit rule, required by the Fiscal Compact, in Estonia and Latvia. It demonstrates how the discursive shifts have been shaped by the localized translations offered by civil servants, the entrance of additional actors to the policy-making arena, crisis experience, and the strategic interests of policy actors.