Implementation of a High-Reliability Organization Framework in a Large Integrated Health Care System: A Pre–Post Quasi-Experimental Quality Improvement Project

Abstract

Introduction The purpose of this quality improvement (QI) project was to evaluate outcomes across Veterans Health Administration (VHA) hospital facilities engaged in an enterprise-wide implementation of a high-reliability organization (HRO) framework. Materials and Methods This QI project relied on primary data drawn from 139 facilities nationwide from 2019 to 2023. Data sources included the All Employee Survey Patient Safety Culture (PSC) Module and patient safety reporting data derived from the Joint Patient Safety Reporting system. The project design applied a pre–post quasi-experimental design that examined within-cohort changes at pre-intervention, intervention, and 2 post-intervention follow-up timepoints. HRO interventions included a combination of training, leadership coaching, site assessments, and experiential learning. HRO interventions were initiated at 18 facilities beginning in 2019 (Cohort 1), 54 facilities in 2020 (Cohort 2), and 67 facilities in 2021 (Cohort 3). For between-cohort analyses, the relative degree of change within Cohort 1 sites was compared with all other sites. Results There were broad positive within-group trends for PSC scores across all sites, and domain-specific between-group differences in PSC Dimension 2—Risk Identification and Just Culture—and Dimension 4—Error Transparency and Risk Mitigation. For patient safety reporting, total events reported, and close calls increased for Cohort 1. The ratio of close calls to adverse events also increased for both Cohort 1 and all other VHA sites at post-intervention year 2. Conclusions The results of this QI project will inform further refinements to VHA’s efforts to implement HRO principles and practices in the nation’s largest integrated health system. In addition, the implementation practices may inform other large-scale, multi-level efforts to improve quality and patient safety.