Search citation statements
Paper Sections
Citation Types
Year Published
Publication Types
Relationship
Authors
Journals
Background The Paediatric early warning system Utilisation and Morbidity Avoidance (PUMA) study was commissioned to develop, implement and evaluate a paediatric track-and-trigger tool for widespread adoption. Following findings from three systematic reviews, revised aims focused on implementation of a whole-systems improvement programme. Objectives (1) Identify, through systematic review, the following: evidence for core components of effective paediatric track-and-trigger tools and paediatric early warning systems, and contextual factors consequential for paediatric track-and-trigger tool and early warning system effectiveness. (2) Develop and implement an evidence-based paediatric early warning system improvement programme (i.e. the PUMA programme). (3) Evaluate the effectiveness of the PUMA programme by examining clinical practice and core outcomes trends. (4) Identify ingredients of successful implementation of the PUMA programme. Review methods The quantitative reviews addressed the following two questions: how well validated are existing paediatric track-and-trigger tools and their component parts for predicting inpatient deterioration? How effective are paediatric early warning systems (with or without a tool) at reducing mortality and critical events? The qualitative review addressed the following question: what sociomaterial and contextual factors are associated with successful or unsuccessful paediatric early warning systems (with or without tools)? Design Interrupted time series and ethnographic case studies were used to evaluate the PUMA programme. Qualitative methods were deployed in a process evaluation. Setting The study was set in two district general and two tertiary children’s hospitals. Intervention The PUMA programme is a paediatric early warning system improvement programme designed to harness local expertise to implement contextually appropriate interventions. Main outcome measures The primary outcome was a composite metric, representing children who experienced one of the following in 1 month: mortality, cardiac arrest, respiratory arrest, unplanned admission to a paediatric intensive care unit or unplanned admission to a high-dependency unit. Paediatric early warning system changes were assessed through ethnographic ward case studies. Results The reviews showed limited effectiveness of paediatric track-and-trigger tools in isolation, and multiple failure points in paediatric early warning systems. All sites made paediatric early warning system changes; some of the clearer quantitative findings appeared to relate to qualitative observations. Systems changed in response to wider contextual factors. Limitations Low event rates made quantitative outcome measures challenging. Implementation was not a one-shot event, creating challenges for the interrupted time series in conceptualising ‘implementation’ and ‘post-intervention’ periods. Conclusions Detecting and acting on deterioration in the acute hospital setting requires a whole-systems approach. The PUMA programme offers a framework to support ongoing system-improvement work; the approach could be used more widely. Organisational-level system change can affect clinical outcomes positively. Alternative outcome measures are required for research and quality improvement. Future work The following further research is recommended: a consensus study to identify upstream indicators of paediatric early warning system performance; an evaluation of OUTCOME approach in other clinical areas; an evaluation of supernumerary nurse co-ordinator role; and an evaluation of mandated system improvement. Study registration This study is registered as PROSPERO CRD42015015326. Funding This project was funded by the National Institute for Health Research (NIHR) Health and Social Care Delivery Research programme and will be published in full in Health and Social Care Delivery Research; Vol. 10, No. 1. See the NIHR Journals Library website for further project information.
Background The Paediatric early warning system Utilisation and Morbidity Avoidance (PUMA) study was commissioned to develop, implement and evaluate a paediatric track-and-trigger tool for widespread adoption. Following findings from three systematic reviews, revised aims focused on implementation of a whole-systems improvement programme. Objectives (1) Identify, through systematic review, the following: evidence for core components of effective paediatric track-and-trigger tools and paediatric early warning systems, and contextual factors consequential for paediatric track-and-trigger tool and early warning system effectiveness. (2) Develop and implement an evidence-based paediatric early warning system improvement programme (i.e. the PUMA programme). (3) Evaluate the effectiveness of the PUMA programme by examining clinical practice and core outcomes trends. (4) Identify ingredients of successful implementation of the PUMA programme. Review methods The quantitative reviews addressed the following two questions: how well validated are existing paediatric track-and-trigger tools and their component parts for predicting inpatient deterioration? How effective are paediatric early warning systems (with or without a tool) at reducing mortality and critical events? The qualitative review addressed the following question: what sociomaterial and contextual factors are associated with successful or unsuccessful paediatric early warning systems (with or without tools)? Design Interrupted time series and ethnographic case studies were used to evaluate the PUMA programme. Qualitative methods were deployed in a process evaluation. Setting The study was set in two district general and two tertiary children’s hospitals. Intervention The PUMA programme is a paediatric early warning system improvement programme designed to harness local expertise to implement contextually appropriate interventions. Main outcome measures The primary outcome was a composite metric, representing children who experienced one of the following in 1 month: mortality, cardiac arrest, respiratory arrest, unplanned admission to a paediatric intensive care unit or unplanned admission to a high-dependency unit. Paediatric early warning system changes were assessed through ethnographic ward case studies. Results The reviews showed limited effectiveness of paediatric track-and-trigger tools in isolation, and multiple failure points in paediatric early warning systems. All sites made paediatric early warning system changes; some of the clearer quantitative findings appeared to relate to qualitative observations. Systems changed in response to wider contextual factors. Limitations Low event rates made quantitative outcome measures challenging. Implementation was not a one-shot event, creating challenges for the interrupted time series in conceptualising ‘implementation’ and ‘post-intervention’ periods. Conclusions Detecting and acting on deterioration in the acute hospital setting requires a whole-systems approach. The PUMA programme offers a framework to support ongoing system-improvement work; the approach could be used more widely. Organisational-level system change can affect clinical outcomes positively. Alternative outcome measures are required for research and quality improvement. Future work The following further research is recommended: a consensus study to identify upstream indicators of paediatric early warning system performance; an evaluation of OUTCOME approach in other clinical areas; an evaluation of supernumerary nurse co-ordinator role; and an evaluation of mandated system improvement. Study registration This study is registered as PROSPERO CRD42015015326. Funding This project was funded by the National Institute for Health Research (NIHR) Health and Social Care Delivery Research programme and will be published in full in Health and Social Care Delivery Research; Vol. 10, No. 1. See the NIHR Journals Library website for further project information.
Paediatric Early Warning Scores (PEWS)are used in hospitalised patients to detect physiological deterioration and is being used increasingly throughout healthcare systems with a limited evidence based. There are two versions in general use that can lead to a clinical response, either by triggering an action or by reaching a ‘threshold’ when graduated responses may occur depending on the value of the score. Most evidence has come from research based on paediatric inpatients in specialist children’s hospitals, although the range of research is expanding, taking into account other clinical areas such as paediatric intensive care unit, emergency department and the prehospital setting. Currrently, it is uncertain whether a unified system does deliver benefits in terms of outcomes or financial savings, but it may inform and improve patient communication. PEWS may be an additional tool in context of a patient’s specific condition, and future work will include its validation for different conditions, different clinical settings, patient populations and organisational structure. The incorporation of PEWS within the electronic health records may form a keystone of the safe system framework and allow the development of consistent PEWS system to standardise practice.
ObjectiveTo assess (1) how well validated existing paediatric track and trigger tools (PTTT) are for predicting adverse outcomes in hospitalised children, and (2) how effective broader paediatric early warning systems are at reducing adverse outcomes in hospitalised children.DesignSystematic review.Data sourcesBritish Nursing Index, Cumulative Index of Nursing and Allied Health Literature, Cochrane Central Register of Controlled Trials, Database of Abstracts of Reviews of Effectiveness, EMBASE, Health Management Information Centre, Medline, Medline in Process, Scopus and Web of Knowledge searched through May 2018.Eligibility criteriaWe included (1) papers reporting on the development or validation of a PTTT or (2) the implementation of a broader early warning system in paediatric units (age 0–18 years), where adverse outcome metrics were reported. Several study designs were considered.Data extraction and synthesisData extraction was conducted by two independent reviewers using template forms. Studies were quality assessed using a modified Downs and Black rating scale.Results36 validation studies and 30 effectiveness studies were included, with 27 unique PTTT identified. Validation studies were largely retrospective case-control studies or chart reviews, while effectiveness studies were predominantly uncontrolled before-after studies. Metrics of adverse outcomes varied considerably. Some PTTT demonstrated good diagnostic accuracy in retrospective case-control studies (primarily for predicting paediatric intensive care unit transfers), but positive predictive value was consistently low, suggesting potential for alarm fatigue. A small number of effectiveness studies reported significant decreases in mortality, arrests or code calls, but were limited by methodological concerns. Overall, there was limited evidence of paediatric early warning system interventions leading to reductions in deterioration.ConclusionThere are several fundamental methodological limitations in the PTTT literature, and the predominance of single-site studies carried out in specialist centres greatly limits generalisability. With limited evidence of effectiveness, calls to make PTTT mandatory across all paediatric units are not supported by the evidence base.PROSPERO registration numberCRD42015015326
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.