Clinical evaluation of an interoperable clinical decision-support system for the detection of systemic inflammatory response syndrome in critically ill children

Abstract

Background Systemic inflammatory response syndrome (SIRS) is defined as a non-specific inflammatory process in the absence of infection. SIRS increases susceptibility for organ dysfunction, and frequently affects the clinical outcome of affected patients. We evaluated a knowledge-based, interoperable clinical decision-support system (CDSS) for SIRS detection on a pediatric intensive care unit (PICU). Methods The CDSS developed retrieves routine data, previously transformed into an interoperable format, by using model-based queries and guideline- and knowledge-based rules. We evaluated the CDSS in a prospective diagnostic study from 08/2018–03/2019. 168 patients from a pediatric intensive care unit of a tertiary university hospital, aged 0 to 18 years, were assessed for SIRS by the CDSS and by physicians during clinical routine. Sensitivity and specificity (when compared to the reference standard) with 95% Wald confidence intervals (CI) were estimated on the level of patients and patient-days. Results Sensitivity and specificity was 91.7% (95% CI 85.5–95.4%) and 54.1% (95% CI 45.4–62.5%) on patient level, and 97.5% (95% CI 95.1–98.7%) and 91.5% (95% CI 89.3–93.3%) on the level of patient-days. Physicians’ SIRS recognition during clinical routine was considerably less accurate (sensitivity of 62.0% (95% CI 56.8–66.9%)/specificity of 83.3% (95% CI 80.4–85.9%)) when measurd on the level of patient-days. Evaluation revealed valuable insights for the general design of the CDSS as well as specific rule modifications. Despite a lower than expected specificity, diagnostic accuracy was higher than the one in daily routine ratings, thus, demonstrating high potentials of using our CDSS to help to detect SIRS in clinical routine. Conclusions We successfully evaluated an interoperable CDSS for SIRS detection in PICU. Our study demonstrated the general feasibility and potentials of the implemented algorithms but also some limitations. In the next step, the CDSS will be optimized to overcome these limitations and will be evaluated in a multi-center study. Trial registration: NCT03661450 (ClinicalTrials.gov); registered September 7, 2018.

Complex decision making in an intensive care environment: Perceived practice versus observed reality

“…30 ICU environments, with their inherent complexity, have been a natural target for CDSS designers. [30][31][32] This study, however, identifies important potential challenges to implementation of these tools.…”

Towards an Evolutionary Open Pediatric Intensive Care Dataset in the ELISE Project

“…We strive for setting up processes to continuously assemble and standardize routine data from a patient data management system of the Pediatric Cardiology and Intensive Care Unit of the Hannover Medical School. Afterwards, we develop a knowledge-based approach using international diagnostic criteria as a basis (see Wulff et al [7,8]), evaluate its diagnostic accuracy and use this approach as a labeling mechanism for assigning outcomes labels to all patients retrospectively. Based on this training data, data-driven approaches for an early detection of the aforementioned diseases will be developed and integrated into an open demonstrator of a clinical decision-support system.…”

It’s All in the Mix: A New Interprofessional, Blended-Learning Masters’ Program for Biomedical Data Science Addressing Physicians and Students from Life Sciences – Didactic Concept and First Experiences

“…These data are collected led by the assumptions that -with more data available -a more holistic image of patients, pathomechanisms, intracellular pathways, and healthcare provision, in general, can be created and that relevant information can be extracted from the data, once integrated. Data-driven application systems, particularly for (clinical) decision support [1], are becoming increasingly relevant in clinical practice, enhancing the demand for experts in this field.…”