Adapting rapid assessment procedures for implementation research using a team-based approach to analysis: a case example of patient quality and safety interventions in the ICU

Abstract

Background: Innovations to improve quality and safety in healthcare are increasingly complex, targeting multiple disciplines and organizational levels, and often requiring significant behavior change by those delivering care. Learning health systems must tackle the crucial task of understanding the implementation and effectiveness of complex interventions, but may be hampered in their efforts by limitations in study design imposed by businesscycle timelines and implementation into fast-paced clinical environments. Rapid assessment procedures are a pragmatic option for producing timely, contextually rich evaluative information about complex interventions implemented into dynamic clinical settings. Methods: We describe our adaptation of rapid assessment procedures and introduce a rapid team-based analysis process using an example of an evaluation of an intensive care unit (ICU) redesign initiative aimed at improving patient safety in four academic medical centers across the USA. Steps in our approach included (1) iteratively working with stakeholders to develop evaluation questions; (2) integration of implementation science frameworks into field guides and analytic tools; (3) selecting and training a multidisciplinary site visit team; (4) preparation and trust building for 2-day site visits; (5) engaging sites in a participatory approach to data collection; (6) rapid team analysis and triangulation of data sources and methods using a priori charts derived from implementation frameworks; and (7) validation of findings with sites. Results: We used the rapid assessment approach at each of the four ICU sites to evaluate the implementation of the sites' innovations. Though the ICU projects all included three common components, they were individually developed to suit the local context and had mixed implementation outcomes. We generated in-depth case summaries describing the overall implementation process for each site; implementation barriers and facilitators for all four sites are presented. One of the site case summaries is presented as an example of findings generated using the method.

Assessing trauma care systems in low-income and middle-income countries: a systematic review and evidence synthesis mapping the Three Delays framework to injury health system assessments

“…Rapid assessments have been described for various health-related conditions and systems for communicable and non-communicable diseases, risk-taking behaviour, humanitarian crises and patient safety. [40][41][42][43][44][45][46] They are advocated when data are needed quickly and resource or logistical constraints mean some research techniques are impractical. 41 Such assessments adopt principles of pragmatism, use of multiple data sources, speed and costeffectiveness.…”

The U.S. State of Tennessee's Medicaid Medication Therapy Management Program: Early Stage Contextual Factors and Implementation Outcomes

“…A rapid analysis approach provided real-time feedback on the program's implementation to TennCare in order for programmatic changes to be made as needed. 20 The project launched July 1, 2018, after which point credentialed pharmacists were approved to provide reimbursable MTM services. This study was approved by the University of Tennessee Health Science Center Institutional Review Board.…”

“…26 Codes were further validated by member checking. Emerging themes and results derived from rapid assessment technique 20 were shared quarterly with stakeholders in formal reports and discussed at monthly meetings between the University and TennCare.…”

Pre-testing of the WHO’s Educational Video: “How to Protect Yourself Against COVID-19”

“…The design of the study was a Rapid Assessment Procedure (RAP), and a qualitative approach was used to collect the data. RAP is a data collection method for obtaining and analyzing in-depth information regarding public health behaviors, during a relatively short period of time, 13,14 and can be used for IEC materials. 15 This study was performed by only five researchers, who had a short time to execute the project, as well as limited funds; therefore, we used the RAP method.…”