No abstract

BackgroundTo improve the delivery of important care processes in the ICU, morning ward round checklists have been implemented in a number of intensive care units (ICUs) internationally. Good quality evidence supporting their use as clinical support tools is lacking. With increased use of technology in clinical settings, integration of such tools into current work practices can be a challenge and requires evaluation. Having completed preliminary work revealing variations in practice and evidence supporting the construct validity of a process-of-care checklist, the need to develop, test and further validate an e(lectronic)-checklist in an ICU was identified.MethodsA prospective, before–after study was conducted in a 19-bed general ICU within a tertiary hospital. Data collection occurred during baseline and intervention periods for 6 weeks each, with education and training conducted over a 4-week period prior to intervention. The e-checklist was used at baseline by ICU research nurses conducting post-ward round audits. During intervention, senior medical staff completed the e-checklist after patient assessments during the morning ward rounds, and research staff conducted post-ward round audits for validity testing (via concordance measurement). To examine changes in compliance over time, checklist-level data were analysed using generalised estimating equations that factored in confounding variables, and statistical process control charts were used to evaluate unit-level data. Established measures of concordance were used to evaluate e-checklist validity.ResultsCompliance with each care component improved significantly over time; the largest improvement was for pain management (42% increase; adjusted odds ratio = 23, p < 0.001), followed by glucose management (22% increase, p < 0.001) and head-of-bed elevation (19% increase, p < 0.001), both with odds ratios greater than 10. Most detected omissions were corrected by the following day. Control charts illustrated reduced variability in care compliance over time. There was good concordance between physician and auditor e-checklist responses; seven out of nine cares had kappa values above 0.8.ConclusionImprovements in the delivery of essential daily care processes were evidenced after the introduction of an e-checklist to the morning ward rounds in an ICU. High levels of agreement between physician and independent audit responses lend support to the validity of the e-checklist.Electronic supplementary materialThe online version of this article (doi:10.1186/s13613-015-0060-1) contains supplementary material, which is available to authorized users.

BackgroundIn the intensive care unit (ICU), checklists can be used to support the delivery of quality and consistent clinical care. While studies have reported important benefits for clinical checklists in this context, lack of formal validity testing in the literature prompted the study aim; to develop relevant ‘process-of-care’ checklist statements, using rigorously applied and reported methods that were clear, concise and reflective of the current evidence base. These statements will be sufficiently instructive for use by physicians during ICU clinical rounds.MethodsA dual-method approach was utilized; semi-structured interviews with local clinicians; and rounds of surveys to an expert Delphi panel. The interviews helped determine checklist item inclusion/exclusion prior to the first round Delphi survey. The panel for the modified-Delphi technique consisted of local intensivists and a state-wide ICU quality committee. Minimum standards for consensus agreement were set prior to the distribution of questionnaires, and rounds of surveys continued until consensus was achieved.ResultsA number of important issues such as overlap with other initiatives were identified in interviews with clinicians and integrated into the Delphi questionnaire, but no additional checklist items were suggested, demonstrating adequate checklist coverage sourced from the literature. These items were verified by local clinicians as being relevant to ICU and important elements of care that required checking during ward rounds. Two rounds of Delphi surveys were required to reach consensus on nine checklist statements: nutrition, pain management, sedation, deep vein thrombosis and stress ulcer prevention, head-of-bed elevation, blood glucose levels, readiness to extubate, and medications.ConclusionsStatements were developed as the most clear, concise, evidence-informed and instructive statements for use during clinical rounds in an ICU. Initial evidence in support of the checklist’s construct validity was established prior to further prospective evaluation in the same ICU.

Early evidence suggests that checklists are one way of ensuring required processes of care are delivered to intensive care unit patients. Evidence to date however, has not explicitly detailed methods of checklist validation in these settings. This study aimed to test the validity of a 'process-of-care' checklist for measuring and ensuring daily care delivery in an intensive care unit. A retrospective audit of a random selection of patient medical records was undertaken to compare with checklist data completed during the same time frame. Documentation in the patients' medical records was used as a proxy measure for actual completion of care. A specific audit tool extracted information from both the checklist and the medical record on the following processes of care: nutrition, weaning from ventilation, pain, glucose control, sit out of bed, bowel management, deep vein thrombosis and stress ulcer prophylaxis. These two data sources were compared using the Spearman's rho correlation coefficient. The two forms of documentation were significantly correlated (P=0.01) for all but one of the checklist items (pain). Findings provided support for the concurrent validity of an intensive care unit process-of-care checklist. Further research is required for checklist validity and reliability testing prior to, or in conjunction with, a planned prospective intervention study.