Health policy analysis: a tool to evaluate in policy documents the alignment between policy statements and intended outcomes

Abstract

Objective. Health policy analysis remains surprisingly undeveloped in Australia given the power that policy exercises over the direction of public health. This paper describes the use of a policy analysis tool to evaluate the alignment between policy statements and intended outcomes of principal chronic illness policy documents in New South Wales (NSW) from 1999 to 2008. In doing so, it demonstrates the utility of a set of predefined criteria for use in retrospective policy analysis and potential for use in reviewing policy proposals and making future health policies.Methods. We analysed the major health policy for the care of people with chronic disease in NSW, the Chronic Care Program, using a modified set of existing criteria derived from the logic of events theoretical framework, which conceptualises the connection between policy determinants and outcomes. A document map was also developed to identify linkages between the policy documents analysed.Results. Internal validity, the alignment between policy statements and intended outcomes, was highest for policy background and goal-setting criteria, and lowest for accessibility, resources, public opportunities and monitoring and evaluation criteria. The use of document mapping was vital in determining linkages between the closely related policy documents of this complex initiative.Conclusions. The use of predefined criteria to identify in policy documents where policy statements are not consistent with intended outcomes, in conjunction with policy mapping, are useful methods of analysing complex policy initiatives. In the Australian context, the use of a validated policy-analysis tool might help achieve greater consistency.Implications. The use of a tool during policy development to identify in policy documents where statements are not consistent with intended outcomes may increase the likelihood of the successful implementation of future health policy. The tool can also assist those who make and review future policies.What is known about the topic? Chronic diseases are an increasing burden on the Australian community and effective policy is required for their prevention and management. Evidence-based policy making has much potential in effecting policy impact yet there is very little Australian research into policy making. Health policy analysis has been conducted in the past but there has not been an attempt to evaluate or analyse the documents that communicate policy in NSW. What does this paper add? This is the first attempt to analyse the policy documentation of a major health initiative for internal validity, that is, the alignment between policy statements and intended outcomes. It offers a framework that may be used to assess policy documents and demonstrates the utility of document maps to identify policy linkages. What are the implications for practitioners? The use of a predefined set of criteria highlights opportunities where policies such as the NSW Chronic Care Program can potentially be strengthened. The criteria can be used by reviewers ...

Advancing team-based primary health care: a comparative analysis of policies in western Canada

“…Also, these innovations require careful evaluation of outcomes associated with different team-based models of care. There is consensus in the literature that clear reporting expectations must exist for continuous improvement of team-based care but current policies offer limited guidance in that respect [2, 9, 23, 24, 26]. …”

Alignment between Chronic Disease Policy and Practice: Case Study at a Primary Care Facility

“…This is concerning since the poor dissemination of policy [34] and inadequate training [30], [35] have been identified as factors contributing to poor policy implementation. Cheung et al [36] highlight the need to carefully analyse policy documents to ensure that there is alignment between policy statements and intended outcomes, as well as the importance of policy documents being easily available to those implementing the policy concerned [36]. Further, in a study done in Tanzania on the implementation of new treatment guidelines for Malaria, inadequate training around this new policy was found to be one of the main reasons for poor policy implementation.…”

Analysis of Higher Education Policy Frameworks for Open and Distance Education in Pakistan

“…This evaluation was done at two levels, that is, at general and specific level. At the general level, the overall policy documents were assessed against a criteria proposed by Cheung, Mirzaei, and Leeder (2010). At the specific level, the proposed program of distance learning was assessed against a criteria set by Gellman- Danley and Fetzner (1998) and Berge (1998).…”