Background
The question of whether quality improvement (QI) actually improves quality in a large healthcare organisation requires overview of a diverse range of QI projects. To-date, an organisational overview remains elusive due to heterogeneity across project-specific outcomes. Where organisational-level assessments of QI success have been offered, the extent to which they could be attributed to QI activity remains unclear. Reporting on a retrospective evaluation of return on investment of QI in a UK National Health Service (NHS) Trust, we discuss the development of a reporting methodology for providing board-level insights on organisational needs and achievements in QI.
Methods
A researcher-in-residence worked with a resident QI team to develop and conduct a retrospective evaluation of QI projects in a large healthcare organisation in the UK that specialises in mental health. Using a survey, we assessed QI project outcomes and explored costs and benefits, as well as contextual, input and process factors that might be associated with whether QI projects led to a change in routine practice.
Findings
Out of 52 QI projects, 10 led to a change in routine practice. Across a diverse range of projects, time invested by staff is an opportunity cost that could serve as a common denominator for return on investment. Retrospective data accrual proved problematic for measuring benefits. Odds ratios from logistic regressions show that process factors had more apparent impact on project outcomes than contextual and input factors. Service user engagement and implementation of measurement plan showed major impact on project outcome. Of note, if QI projects had documentation for Plan-Do-Study-Act (PDSA) cycles, the odds of effecting a change in routine practice were much higher.
Conclusions
To inform organisational-level decision making and optimise return on investment from QI in large healthcare organisations, systematic monitoring of QI activity needs prospective data accrual, consistent measurement and coherent iterations. We recommend that this be undertaken by a resident QI unit with the data categories explored in this study. Developing a reporting methodology for routine organisational-level monitoring can be an asset for improving practice, one that is pivotal for a learning healthcare system.