Closing the regulatory cycle? A meta evaluation of ex-post legislative evaluations by the European Commission

Abstract

Theoretically, ex-post legislative (EPL) evaluations play an important role in the European regulatory cycle. By critically assessing the administration, compliance or outcomes of legislation, they may allow for learning and inform enforcement. At the same time, the European Commission may have incentives not to evaluate, as EPL evaluations may lead to undesired policy change or repeal. Furthermore, the development of systematic, highquality EPL evaluations is threatened by more technical problems in the sphere of evaluability. Hence, the odds are against the systematic production of high-quality evaluations in the European Union (EU). This article assesses this argument by conducting a meta evaluation of the coverage and quality of ex-post legislative evaluations by the European Commission, using two novel datasets. The main findings are that EPL evaluation coverage indeed is patchy, with no clear upward trend in recent years. EPL evaluation is primarily a matter of legislative obligation instead of own initiative. There is great scope, finally, for enhancing the quality of EPL evaluations, by improving methodological quality, stakeholder involvement and transparency.

Larger and more law abiding? The impact of enlargement on compliance in the European Union

“…Of course such counter-evidence to decoupling can also be criticised for relying on evaluation reports (the quality of which can also be contested, see Mastenbroek et al 2015) and/or on a still limited number of policy areas. Clearly, there is evidence for some serious compliance problems regarding the practical application of EU law in the post-communist member states that merit further investigation.…”

Halfway Through the Better Regulation Strategy of the Juncker Commission: What Does the Evidence Say?

“…As mentioned, the idea is that impact assessment work should draw on ex‐post evaluations. A couple of studies deal with the results achieved in closing the policy cycle (Mastenbroek et al ., ; van Golen and van Voorst, ). Van Golen and van Voorst gathered 309 ex‐post legislative evaluations and 225 impact assessments.…”

Adaptieve beleidsontwikkeling: zoeken naar nieuwe vormen van beleidsanalyse voor de digitale overheid

“…Ex-post studies worden vaker uitgevoerd, maar niet altijd. Wat betreft evaluaties die in het kader van Europese wetgeving moeten worden uitgevoerd, laten Mastenbroek et al (2016Mastenbroek et al ( : 1338Mastenbroek et al ( -1340 zien dat maar in een derde van de gevallen ook daadwerkelijk zo'n studie wordt uitgevoerd. Verder wisselt de methodologische kwaliteit sterk: in ongeveer iets minder dan de helft van het aantal studies was sprake van voldoende kwaliteit.…”