“Scaling-out” evidence-based interventions to new populations or new health care delivery systems

Abstract

BackgroundImplementing treatments and interventions with demonstrated effectiveness is critical for improving patient health outcomes at a reduced cost. When an evidence-based intervention (EBI) is implemented with fidelity in a setting that is very similar to the setting wherein it was previously found to be effective, it is reasonable to anticipate similar benefits of that EBI. However, one goal of implementation science is to expand the use of EBIs as broadly as is feasible and appropriate in order to foster the greatest public health impact. When implementing an EBI in a novel setting, or targeting novel populations, one must consider whether there is sufficient justification that the EBI would have similar benefits to those found in earlier trials.DiscussionIn this paper, we introduce a new concept for implementation called “scaling-out” when EBIs are adapted either to new populations or new delivery systems, or both. Using existing external validity theories and multilevel mediation modeling, we provide a logical framework for determining what new empirical evidence is required for an intervention to retain its evidence-based standard in this new context. The motivating questions are whether scale-out can reasonably be expected to produce population-level effectiveness as found in previous studies, and what additional empirical evaluations would be necessary to test for this short of an entirely new effectiveness trial. We present evaluation options for assessing whether scaling-out results in the ultimate health outcome of interest.ConclusionIn scaling to health or service delivery systems or population/community contexts that are different from the setting where the EBI was originally tested, there are situations where a shorter timeframe of translation is possible. We argue that implementation of an EBI in a moderately different setting or with a different population can sometimes “borrow strength” from evidence of impact in a prior effectiveness trial. The collection of additional empirical data is deemed necessary by the nature and degree of adaptations to the EBI and the context. Our argument in this paper is conceptual, and we propose formal empirical tests of mediational equivalence in a follow-up paper.

Community health promotion programs for older adults: What helps and hinders implementation

“…We define scale‐up as “the process by which health interventions shown to be efficacious on a small scale and or under controlled conditions are expanded under real world conditions into broader policy or practice” . We define scale‐out as the “deliberate use of strategies to implement, test, improve, and sustain an evidence‐based intervention as it is delivered to new populations and/or through new delivery systems” …”

“…14 We define scale-out as the "deliberate use of strategies to implement, test, improve, and sustain an evidence-based intervention as it is delivered to new populations and/or through new delivery systems". 24 The primary objective of this study is to examine implementation of community-driven health promotion programs aimed to increase PA and social connectedness for older adults in remote and rural regions across British Columbia. comprised of university-based researchers and highly qualified support staff; www.activeagingrt.ca).…”

Recipient and Instructor perspectives of an adapted exercise-based fall prevention program for older adults with vision impairment: a qualitative study nested within a randomised controlled trial

“…24 It is critical to document these adaptations in order to understand the impacts specific adaptations may have on the positive findings when these programs are evaluated for effectiveness. 25 The practical adaptations reported in this paper can inform future research and further integration of public health interventions for people with vision impairment.…”

A type II implementation-effectiveness hybrid quasi-experimental pilot study of a clinical intervention to re-engage people living with HIV into care, ‘Lost & Found’: an implementation science protocol

“…We will use an implementation science approach to facilitate the adaptation and evaluation of Lost & Found in our clinic [16]. The findings from this study will highlight implementation strategies leading to successful local adaptation and real-world effectiveness [20].…”