The effects of on-screen, point of care computer reminders on processes and outcomes of care

Abstract

Background The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering ‘computer reminders’. Objectives To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care. Search methods We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles. Selection criteria Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care. Data collection and analysis Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome. Main results Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase). Authors’ conclusions Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.

Reducing PSA-Based Prostate Cancer Screening in Men Aged 75 Years and Older with the Use of Highly Specific Computerized Clinical Decision Support

“…5,6,20,21 This study supports prior work demonstrating the capacity of health information technology to improve processes of care and of CCDS to change provider behavior. [22][23][24] Our study found a median benefit of 2.1 % to clinical process-of-care measures, similar to the rate of 3.8 % found in a 2009 Cochrane Review on the effect of CCDS on process of care. In the same Cochrane Review, only 4 of the 32 included studies looked at CCDS tools as a way to reduce unwanted behavior.…”

“…In the same Cochrane Review, only 4 of the 32 included studies looked at CCDS tools as a way to reduce unwanted behavior. 24 Our study adds to the small number of studies in this area, and appears to confirm the finding that CCDS instruments are equally effective at increasing and decreasing behaviors. It also demonstrated a significant change in provider behavior, despite a relatively small gap in quality.…”

Effectiveness of telemedicine: A systematic review of reviews

“…Computer reminders to professionals at the point of care show 'small to modest improvements' in professional behaviour, but studies are heterogeneous and interventions complex, making these difficult to understand [49].…”

Guías de práctica clínica: una introducción a su elaboración e implementación

“…En el caso de la auditoría y retroalimentación, los mayores efectos se observaron en aquellos casos con adherencia basal más baja 40 . Finalmente, en el caso de los recordatorios la mayoría de los estudios han evaluado intervenciones relativamente simples dirigidas a modificar comportamientos de baja complejidad (por ejemplo, prescripción) 41 .…”