The ENCOMPASS framework: a practical guide for the evaluation of public health programmes in complex adaptive systems

Abstract

Background Systems thinking embraces the complexity of public health problems, including childhood overweight and obesity. It aids in understanding how factors are interrelated, and it can be targeted to produce favourable changes in a system. There is a growing call for systems approaches in public health research, yet limited practical guidance is available on how to evaluate public health programmes within complex adaptive systems. The aim of this paper is to present an evaluation framework that supports researchers in designing systems evaluations in a comprehensive and practical way. Methods We searched the literature for existing public health systems evaluation studies. Key characteristics on how to conduct a systems evaluation were extracted and compared across studies. Next, we overlaid the identified characteristics to the context of the Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme evaluation and analyzed which characteristics were essential to carry out the LIKE evaluation. This resulted in the Evaluation of Programmes in Complex Adaptive Systems (ENCOMPASS) framework. Results The ENCOMPASS framework includes five iterative stages: (1) adopting a system dynamics perspective on the overall evaluation design; (2) defining the system boundaries; (3) understanding the pre-existing system to inform system changes; (4) monitoring dynamic programme output at different system levels; and (5) measuring programme outcome and impact in terms of system changes. Conclusions The value of ENCOMPASS lies in the integration of key characteristics from existing systems evaluation studies, as well as in its practical, applied focus. It can be employed in evaluating public health programmes in complex adaptive systems. Furthermore, ENCOMPASS provides guidance for the entire evaluation process, all the way from understanding the system to developing actions to change it and to measuring system changes. By the nature of systems thinking, the ENCOMPASS framework will likely evolve further over time, as the field expands with more completed studies.

A Theoretical Perspective on Why Socioeconomic Health Inequalities Are Persistent: Building the Case for an Effective Approach

“…Moreover, it is important to monitor and evaluate the process and effects of development and implementation of whole system approaches. The ENCOMPASS framework that is specifically developed for evaluating approaches in complex adaptive systems could, for example, be used [ 97 ]. Research on the application of the mentioned methodologies and frameworks in different contexts could help to generate more insight into what works in systems thinking and whole system approaches.…”

The association between the presence of fast-food outlets and BMI: the role of neighbourhood socio-economic status, healthy food outlets, and dietary factors

“…Moreover, future studies should examine overweight and obesity using systems dynamics approaches. Such approaches model overweight and obesity as part of a complex system [62][63][64], and could thereby move beyond bivariate exposure-outcome associations.…”

Towards a framework for the scale-up of rehabilitation for patients with non-communicable disease in low-resource settings

“…Hence, we argue that this work should be considered a template of factors that can be considered in the scale-up rehabilitation and program optimization, yet that contextualisation to any specific situation is required. (38)…”