Assessing Instrument Mixes through Program‐ and Agency‐Level Data: Methodological Issues in Contemporary Implementation Research

Abstract

Theories of policy instrument choice have gone through several "generations" as theorists have moved from the analysis of individual instruments to comparative studies of instrument selection and the development of theories of instrument choice within implementation "mixes" or "governance strategies." Current "next generation" theory on policy instruments centers on the question of the optimality of instrument choices. However, empirically assessing the nature of instrument mixes is quite a complex affair, involving considerable methodological difficulties and conceptual ambiguities related to the definition and measurement of policy sector and instruments and their interrelationships. Using materials generated by Canadian governments, this article examines the practical utility and drawbacks of three techniques used in the literature to inventory instruments and identify instrument ecologies and mixes: the conventional "policy domain" approach suggested by Burstein (1991); the "program" approach developed by Rose (1988a); and the "legislative" approach used by Hosseus and Pal (1997). This article suggests that all three approaches must be used in order to develop even a modest inventory of policy instruments, but that additional problems exist with availability and accessibility of data, both in general and in terms of reconciling materials developed using these different approaches, which makes the analysis of instrument mixes a time-consuming and expensive affair. Copyright 2006 by The Policy Studies Organization.

Affective Policy Performance Evaluation Model: A Case of an International Trade Policy Implementation

“…Furthermore, firms may not understand the importance or even the existence of certain trade policies [11,12]. Moreover, they may become discouraged in carrying out the policies because of the lack of appropriate knowledge, infrastructure, and human resources [13,14].…”

“…Third, operational resources to carry on implementing and practicing policies are another representative resource of policy implementation [13,14]. Establishing those operational resources is challenging for both governments and firms not only because it demands large expenditures but also the number of different policies and their varied requirements make it more challenging to customize their operational resources.…”

“…Likewise, the firm-based facilitating conditions refer to the operational resources, such as human resources, internal culture toward policies, and information systems. An appropriate management of the policy facilitating conditions is critical for both governments and firms [13,14]. Thus, trade policy administrators in both governments and firms make considerable efforts in deciding the proper resource allocation and management for the facilitating conditions.…”

“…If they have incomplete information, they will have difficulties visualizing how the trade policy would work and are unable to evaluate its benefits, costs, or risks [18]. Information on trade policies could be attained through raising public awareness [14]. With high public awareness of a trade policy, associates in firms are more likely to understand the purpose and importance of the policy [11].…”

Responsive governance and complex urban settings: Responding to change in an urban policy arena - Brisbane (QLD) Australia and Portland (OR) USA

“…Similarly, policy instrument research can show how change can manifest within instrument mixes and policy frameworks (Howlett 2000, Howlett et al 2006, and then with a focus on actors that participate in these instruments, the agency behind these instrument changes can be explored. Finally, the policy evaluation research shows how monitoring and evaluation of policy can indicate how actors are involved or not involved in responsive decision making and show what policy outcomes are considered important (Dryzek 1987b, Palumbo 1987, Cook and Skogan 1991, Bridgman and Davis 2004).…”