Implementation fidelity and acceptability of an intervention to improve vaccination uptake and child health in rural India: a mixed methods evaluation of a pilot cluster randomized controlled trial

Abstract

Background The Tika Vaani intervention, an initiative to improve basic health knowledge and empower beneficiaries to improve vaccination uptake and child health for underserved rural populations in India, was assessed in a pilot cluster randomized trial. The intervention was delivered through two strategies: mHealth (using mobile phones to send vaccination reminders and audio-based messages) and community mobilization (face-to-face meetings) in rural Indian villages from January to September 2018. We assessed acceptability and implementation fidelity to determine whether the intervention delivered in the pilot trial can be implemented at a larger scale. Methods We adapted the Conceptual Framework for implementation fidelity to assess acceptability and fidelity of the pilot interventions using a mixed methods design. Quantitative data sources include a structured checklist, household surveys, and mobile phone call patterns. Qualitative data came from field observations, intervention records, semi-structured interviews and focus groups with project recipients and implementers. Quantitative analyses assessed whether activities were implemented as planned, using descriptive statistics to describe participant characteristics and the percentage distribution of activities. Qualitative data were analyzed using content analysis and in the light of the implementation fidelity model to explore moderating factors and to determine how well the intervention was received. Results Findings demonstrated high (86.7%) implementation fidelity. A total of 94% of the target population benefited from the intervention by participating in a face-to-face group meeting or via mobile phone. The participants felt that the strategies were useful means for obtaining information. The clarity of the intervention theory, the motivation, and commitment of the implementers as well as the periodic meetings of the supervisors largely explain the high level of fidelity obtained. Geographic distance, access to a mobile phone, level of education, and gender norms are contextual factors that contributed to heterogeneity in participation. Conclusions Although the intervention was evaluated in the context of a randomized trial that could explain the high level of fidelity obtained, this evaluation provides confirmatory evidence that the results of the study reflect the underlying theory. The mobile platform coupled with community mobilization was well-received by the participants and could be a useful way to improve health knowledge and change behavior. Trial registration ISRCTN 44840759 (22 April 2018)

Use of community engagement interventions to improve child immunisation in low‐ and middle‐income countries: A systematic review and meta‐analysis

“…In all cases, the most consistent issue was that realities on the ground forced changes to the intervention. The issue of mobilising people into the intervention appears to be common; however, this category is dominated by two papers (Olken, 2014; Pérez et al, 2020) which cite a variety of mobilisation challenges. As such, the evidence on this theme is somewhat weak.…”

“…Mobilisation challenges largely related to recruiting people into the intervention. Most of this information came from a 2020 (Pérez et al, 2020) paper which presented information on the implementation fidelity and acceptability of an intervention that combined in‐person and digital education to promote vaccination (Johri et al, 2020). Authors describe challenges with participants being unable to attend due to work, distance, and competing priorities.…”

Considering social inequalities in health in large-scale testing for COVID-19 in Montréal: a qualitative case study

“…Reinvention of public health interventions as they are implemented can improve their effectiveness, showing that they are flexible enough to be adapted to emerging local needs [ 59 ]. Targeted outreach efforts in community settings, involvement of community leaders and organisations, and cultural adaptation of services were identified as promising strategies for increasing the accessibility, acceptability, and availability of large-scale testing [ 48 , 60 ].…”

Assessing the implementation fidelity of HPV self-collection offered by Community Health Workers during home visits (the EMA strategy): a case study in a low-middle resource setting in Argentina

“…The percentage of implemented activities represented the degree of delity. Based on other studies that evaluate implementation delity in community settings 30 the following scoring categories were used in this study: 80-100%, high; 79-51%, moderate; and ≤ 50%, low.…”