Methods for exploring implementation variation and local context within a cluster randomised community intervention trial

Abstract

Insignificant or modest findings in intervention trials may be attributable to poorly designed or theorised interventions, poorly implemented interventions, or inadequate evaluation methods. The pre-existing context may also account for the effects observed. A combination of qualitative and quantitative methods is outlined that will permit the determination of how context level factors might modify intervention effectiveness, within a cluster randomised community intervention trial to promote the health of mothers with new babies. The methods include written and oral narratives, key informant interviews, impact logs, and inter-organisational network analyses. Context level factors, which may affect intervention uptake, success, and sustainability are the density of inter-organisational ties within communities at the start of the intervention, the centrality of the primary care agencies expected to take a lead with the intervention, the extent of context-level adaptation of the intervention, and the amount of local resources contributed by the participating agencies. Investigation of how intervention effects are modified by context is a new methodological frontier in community intervention trial research.

Pragmatic Trials

“…2 93 Any variation in the intervention needs recording, whether or not it is intended, so that fidelity can be assessed in relation to the degree of standardisation required by the study protocol. 2 …”

“…It re-emphasises some of the key messages, but also tries to address the limitations identified by (1) providing a more flexible, less linear model of the process, giving due weight to the development and implementation phases, as well as to evaluation, and (2) giving examples of successful approaches to the development and evaluation of a variety of complex interventions, using a range of methods from clinical trials to natural experiments. While some aspects of good practice are clear, methods for developing, evaluating and implementing complex interventions are still being developed, and on many important issues there is no consensus yet on what is best practice.…”

Designing and Undertaking a Health Economics Study of Digital Health Interventions

“…[10][11][12] Within the Medical Research Council Framework for the Evaluation of Complex Interventions, 13 a complex intervention is one that "contains several interacting components, and other characteristics, such as the number and difficulty of behaviors required by those delivering or receiving the intervention." Complexity may also refer to features of the system in which an intervention is implemented, as well as the intervention itself.…”

Strengthening the rigour of population-wide, community-based obesity prevention evaluations

“…A common criticism of process evaluation is that it presupposes and mechanistically assesses specified intervention components (66) . While this has merit, it ignores other contextual factors which could operate as effect modifiers.…”