An Implementation Research Approach to Evaluating Health Insurance Programs: Insights from India

Abstract

One of the distinguishing features of implementation research is the importance given to involve implementers in all aspects of research, and as users of research. We report on a recent implementation research effort in India, in which researchers worked together with program implementers from one of the longest serving government funded insurance schemes in India, the Rajiv Aarogyasri Scheme (RAS) in the state of undivided Andhra Pradesh, that covers around 70 million people. This paper aims to both inform on the process of the collaborative research, as well as, how the nature of questions that emerged out of the collaborative exercise differed in scope from those typically asked of insurance program evaluations. Starting in 2012, and over the course of a year, staff from the Aarogyasri Health Care Trust (AHCT), and researchers held a series of meetings to identify research questions that could serve as a guide for an evaluation of the RAS. The research questions were derived from the application of a Logical Framework Approach ("log frame") to the RAS. The types of questions that emerged from this collaborative effort were compared with those seen in the published literature on evaluations of insurance programs in low-and middle-income countries (LMICs). In the published literature, 60% of the questions pertained to output/outcome of the program and the remaining 40%, relate to processes and inputs. In contrast, questions generated from the RAS participatory research process between implementers and researchers had a remarkably different distribution -81% of questions looked at program input/ processes, and 19% on outputs and outcomes. An implementation research approach can lead to a substantively different emphasis of research questions. While there are several challenges in collaborative research between implementers and researchers, an implementation research approach can lead to incorporating tacit knowledge of program implementers into the research process, research questions that are more relevant to the research needs of policy-makers, and greater knowledge translation of the research findings. BackgroundThe emerging field of implementation research seeks to focus research attention on issues concerning program implementation to improve program effectiveness. It emphasizes generating knowledge for action and not just for the sake of 'better understanding. ' 1-3 One of the distinguishing features of implementation research is the importance given to both the context within which a program operates, as well as, the population that is affected by the program. In particular, it seeks to involve implementers and populations affected by an intervention in all aspects of research right from research design, the process of research, and as users of research.

Strengthening health policy development and management systems in low- and middle- income countries: South Africa's approach

“…To facilitate management of policies across a ministry or department of health, the literature supported establishing consistent frameworks for M&E plans [ 11 , 21 , 29 , 33 , 41 , 57 , 60 , 68 , 72 , 74 , 83 , 85. , 86.…”

“…Sufficient education and training should be provided to implementers on policy details, and this training must be relevant to their role in policy implementation. [ 7 , 28 , 29 , 31 , 33 , 35 , 36 , 38 , 39 , 41 , 42 , 51 , 54 , 58 , 59 , 61 , 62 , 64 , 68 , 70 , 72 , 74 , 95 , 102. , 103.…”

Attainment of the sustainable development goal of poverty eradication: A review, critique, and research agenda

“…However, there is a need for a targeted approach toward the urban poor regarding health insurance. There is an urgent need for promoting technology support, product awareness, better pricing, and regulation of health insurance products (Bhat, Holtz, & Avila, 2018; Rao et al, 2016). Ayushman Bharath Pradhan Manthri Jan Arogya Yogna is a scheme with the objective of universal health coverage in India.…”

How does embedded implementation research work? Examining core features through qualitative case studies in Latin America and the Caribbean

“…By definition, an implementation focus considers the nature of the programme, processes through which they are delivered, the role and responsibility of actors at different levels, and the context in which this occurs ( Damschroder et al ., 2009 ). Others have shown that an implementation focus results in substantively different research questions as compared with other approaches to programme improvement ( Rao et al ., 2016 ). Careful formulation of the research question(s) is needed to ensure results are relevant and actionable within the local reality for programme improvement.…”