Background: Global health partnerships have grown rapidly in number and scope, yet there has been less emphasis on their evaluation. Gavi, the Vaccine Alliance, is one such public-private partnership; in Gavi-eligible countries partnerships are dynamic networks of immunization actors who work together to support all stages and aspects of Gavi support. This paper describes a conceptual framework – the partnership framework – and analytic approach for evaluating the perceptions of partnerships’ added value as well as the results from an application to one case in Uganda. Methods: We used a mixed-methods case study design embedded in the Gavi Full Country Evaluations (FCE) to test the partnership framework on Uganda’s human papillomavirus (HPV) vaccine application partnership. Data from document review, interviews, and social network surveys enabled the testing of the relationships between partnership framework domains (context, structure, practices, performance, and outcomes). Topic guides were based on the framework domains and network surveys identified working together relationships, professional trust, and perceptions of the effectiveness, efficiency, and legitimacy of the partnership’s role in this process. Results: Data from seven in-depth interviews, 11 network surveys and document review were analyzed according to the partnership framework, confirming relationships between the framework domains. Trust was an important contributor to the perceived effectiveness of the process. The network was structured around the EPI program, who was considered the leader of this process. While the structure and composition of the network was largely viewed as supporting an effective and legitimate process, the absence of the Ministry of Education (MoE) may have had downstream consequences if this study’s results had not been shared with the Ministry of Health (MoH) and acted upon. The partnership was not perceived to have increased the efficiency of the process, perhaps as a result of unclear or absent guidelines around roles and responsibilities. Conclusion: The health and functioning of global health partnerships can be evaluated using the framework and approach presented here. Network theory and methods added value to the conceptual and analytic processes and we recommend applying this approach to other global health partnerships to ensure that they are meeting the complex challenges they were designed to address.

No abstract

Vaccination, like most other public health services, relies on a complex package of intervention components, functioning systems and committed actors to achieve universal coverage. Despite significant investment in immunization programmes, national coverage trends have slowed and equity gaps have grown. This paper describes the design and implementation of the Gavi Full Country Evaluations, a multi-country, prospective, mixed-methods approach whose goal was to monitor and evaluate processes, inputs, outputs and outcomes of immunization programmes in Bangladesh, Mozambique, Uganda and Zambia. We implemented the Full Country Evaluations from 2013 to 2018 with the goal of identifying the drivers of immunization programme improvement to support programme implementation and increase equitable immunization coverage. The framework supported methodological and paradigmatic flexibility to respond to a broad range of evaluation and implementation research questions at global, national and cross-country levels, but was primarily underpinned by a focus on evaluating processes and identifying the root causes of implementation breakdowns. Process evaluation was driven by theories of change for each Gavi funding stream (e.g. Health Systems Strengthening) or activity, ranging from global policy development to district-level programme implementation. Mixing of methods increased in relevance and rigour over time as we learned to build multiple methods into increasingly tailored evaluation questions. Evaluation teams in country-based research institutes increasingly strengthened their level of embeddedness with immunization programmes as the emphasis shifted over time to focus more heavily on the use of findings for programme learning and adaptation. Based on our experiences implementing this approach, we recommend it for the evaluation of other complex interventions, health programmes or development assistance.

BackgroundThe under-5 mortality rate (U5MR) is an important metric of child health and survival. Country-level estimates of U5MR are readily available, but efforts to estimate U5MR subnationally have been limited, in part, due to spatial misalignment of available data sources (e.g., use of different administrative levels, or as a result of historical boundary changes).MethodsWe analyzed all available complete and summary birth history data in surveys and censuses in six countries (Bangladesh, Cameroon, Chad, Mozambique, Uganda, and Zambia) at the finest geographic level available in each data source. We then developed small area estimation models capable of incorporating spatially misaligned data. These small area estimation models were applied to the birth history data in order to estimate trends in U5MR from 1980 to 2015 at the second administrative level in Cameroon, Chad, Mozambique, Uganda, and Zambia and at the third administrative level in Bangladesh.ResultsWe found substantial variation in U5MR in all six countries: there was more than a two-fold difference in U5MR between the area with the highest rate and the area with the lowest rate in every country. All areas in all countries experienced declines in U5MR between 1980 and 2015, but the degree varied both within and between countries. In Cameroon, Chad, Mozambique, and Zambia we found areas with U5MRs in 2015 that were higher than in other parts of the same country in 1980. Comparing subnational U5MR to country-level targets for the Millennium Development Goals (MDG), we find that 12.8% of areas in Bangladesh did not meet the country-level target, although the country as whole did. A minority of areas in Chad, Mozambique, Uganda, and Zambia met the country-level MDG targets while these countries as a whole did not.ConclusionsSubnational estimates of U5MR reveal significant within-country variation. These estimates could be used for identifying high-need areas and positive deviants, tracking trends in geographic inequalities, and evaluating progress towards international development targets such as the Sustainable Development Goals.Electronic supplementary materialThe online version of this article (10.1186/s12963-018-0171-7) contains supplementary material, which is available to authorized users.

No abstract