Advancing integrated care evaluation in shifting contexts: Blending implementation research with case study design in Project SUSTAIN.

Abstract

Background Despite many studies evaluating the effectiveness of integrated care, evidence remains inconsistent. There is increasing commentary pointing out the mismatch between the ability to capture the somewhat ‘illusive’ impact of integrated care initiatives and programmes, and the most appropriate way to do this. Focusing on methodology, this paper describes and critically reviews the experiences of SUSTAIN, a Horizon 2020 funded project (2015–2019) with the purpose of advancing knowledge and understanding of cross-European integrated care evaluation. SUSTAIN sought to improve integrated care initiatives for older people in seven countries, and to maximise the potential for knowledge transfer and application across Europe. The methods approach drew from implementation research, employing the participative Evidence Integration Triangle (EIT) and incorporating a mixed method, multiple embedded case study design. A core set of qualitative and quantitative indicators, alongside context and process data, were created and tested within four key project domains (person-centredness, prevention-orientation, safety and efficiency). The paper critically discusses the overall approach, highlighting the value of the EIT and case study design, and signalling the challenges of data collection with frail older people and stakeholder involvement at the sites, as well as difficulties developing the core set of indicators. Conclusions Lessons learned and recommendations for advancing integrated care evaluation are put forward that focus on the status of integrated care as a complex intervention and a process. The use of implementation research methods and case study design are recommended, alongside suggested ways of improving methods of data collection with frail populations and cost analysis.

Evaluating the implementation of a person-centred transition programme for adolescents and young adults with long-term conditions: the role of context and organisational behaviour

“…Although a number of studies have identified factors that influence implementation (Hergenroeder et al, 2016;Kingsnorth et al, 2011;Watson et al, 2011), the role of context and its influence on transition programme implementation has, to date, not been fully explored. There is a significant body of existing research that helps us understand how contextual factors influence the implementation of complex healthcare interventions (Paparini et al, 2021;Billings et al, 2020;Dryden-Palmer et al, 2020;Rogers et al, 2020;Gagliardi et al, 2014). However, with the exception of studies undertaken by Saarij€ arvi et al (2021Saarij€ arvi et al ( , 2022, there remains limited empirical evidence specific to why and how implementation processes and contexts determine the success or failure of transition programmes.…”

“…There is a significant body of existing research that helps us understand how contextual factors influence the implementation of complex healthcare interventions (Paparini et al. , 2021; Billings et al. , 2020; Dryden-Palmer et al.…”