Design and Usability of an Electronic Health Record—Integrated, Point-of-Care, Clinical Decision Support Tool for Modeling and Simulation of Antihemophilic Factors
Abstract:Background With the consequences of inadequate dosing ranging from increased bleeding risk to excessive drug costs and undesirable administration regimens, the antihemophilic factors are uniquely suited to dose individualization. However, existing options for individualization are limited and exist outside the flow of care. We developed clinical decision support (CDS) software that is integrated with our electronic health record (EHR) and designed to streamline the process for our hematology providers.
… Show more
“…Clinician informational needs and preferences for CDS design is important to optimize acceptance and adherence to CDS recommendations. [26][27][28][29][30] Finally, the relative risk calculations for diLQTS in this investigation were conducted broadly at the drug level across all patients, ignoring the specific patient-level information that may have placed a given patient at greater or lesser risk of diLQTS. Accurate risk prediction of diLQTS is an active area of research in our group, and we anticipate that with improved prediction modeling, a more accurate risk assessment could both improve accuracy of CDS alerts, as well as provide more meaningful guidance for providers at the time of prescription.…”
Objective Clinical decision support (CDS) alerts built into the electronic health record (EHR) have the potential to reduce the risk of drug-induced long QT syndrome (diLQTS) in susceptible patients. However, the degree to which providers incorporate this information into prescription behavior and the impact on patient outcomes is often unknown.
Methods We examined provider response data over a period from October 8, 2016 until November 8, 2018 for a CDS alert deployed within the EHR from a 13-hospital integrated health care system that fires when a patient with a QTc ≥ 500 ms within the past 14 days is prescribed a known QT-prolonging medication. We used multivariate generalized estimating equations to analyze the impact of therapeutic alternatives, relative risk of diLQTS for specific medications, and patient characteristics on provider response to the CDS and overall patient mortality.
Results The CDS alert fired 15,002 times for 7,510 patients for which the most common response (51.0%) was to override the alert and order the culprit medication. In multivariate models, we found that patient age, relative risk of diLQTS, and presence of alternative agents were significant predictors of adherence to the CDS alerts and that nonadherence itself was a predictor of mortality. Risk of diLQTS and presence of an alternative agent are major factors in provider adherence to a CDS to prevent diLQTS; however, provider nonadherence was associated with a decreased risk of mortality.
Conclusion Surrogate endpoints, such as provider adherence, can be useful measures of CDS value but attention to hard outcomes, such as mortality, is likely needed.
“…Clinician informational needs and preferences for CDS design is important to optimize acceptance and adherence to CDS recommendations. [26][27][28][29][30] Finally, the relative risk calculations for diLQTS in this investigation were conducted broadly at the drug level across all patients, ignoring the specific patient-level information that may have placed a given patient at greater or lesser risk of diLQTS. Accurate risk prediction of diLQTS is an active area of research in our group, and we anticipate that with improved prediction modeling, a more accurate risk assessment could both improve accuracy of CDS alerts, as well as provide more meaningful guidance for providers at the time of prescription.…”
Objective Clinical decision support (CDS) alerts built into the electronic health record (EHR) have the potential to reduce the risk of drug-induced long QT syndrome (diLQTS) in susceptible patients. However, the degree to which providers incorporate this information into prescription behavior and the impact on patient outcomes is often unknown.
Methods We examined provider response data over a period from October 8, 2016 until November 8, 2018 for a CDS alert deployed within the EHR from a 13-hospital integrated health care system that fires when a patient with a QTc ≥ 500 ms within the past 14 days is prescribed a known QT-prolonging medication. We used multivariate generalized estimating equations to analyze the impact of therapeutic alternatives, relative risk of diLQTS for specific medications, and patient characteristics on provider response to the CDS and overall patient mortality.
Results The CDS alert fired 15,002 times for 7,510 patients for which the most common response (51.0%) was to override the alert and order the culprit medication. In multivariate models, we found that patient age, relative risk of diLQTS, and presence of alternative agents were significant predictors of adherence to the CDS alerts and that nonadherence itself was a predictor of mortality. Risk of diLQTS and presence of an alternative agent are major factors in provider adherence to a CDS to prevent diLQTS; however, provider nonadherence was associated with a decreased risk of mortality.
Conclusion Surrogate endpoints, such as provider adherence, can be useful measures of CDS value but attention to hard outcomes, such as mortality, is likely needed.
“…Many technologies focused on the creation and evaluation of customized clinical decision support tools. The application of these customized clinical decision support tools varied widely in context, including diagnostic support [ 17 , 132 ], antibiotic stewardship [ 36 , 70 ], screening for and management of chronic conditions [ 53 , 91 , 119 ], identifying individuals at risk for varied clinical outcomes [ 50 , 69 , 87 , 118 ].…”
Section: Resultsmentioning
confidence: 99%
“…In this synthesis, we focused on categorizing studies based on the expansion of health informatics design opportunities supported by the (relatively) recent ability to customize EHR interfaces, open APIs that allow developers to directly create new software tools leveraging EHR data, and increasingly accessible platforms for mobile app development. [53,91,119], identifying individuals at risk for varied clinical outcomes [50,69,87,118].…”
Objective: Human factors and ergonomics (HF/E) frameworks and methods are becoming embedded in the health informatics community. There is now broad recognition that health informatics tools must account for the diverse needs, characteristics, and abilities of end users, as well as their context of use. The objective of this review is to synthesize the current nature and scope of HF/E integration into the health informatics community.
Methods: Because the focus of this synthesis is on understanding the current integration of the HF/E and health informatics research communities, we manually reviewed all manuscripts published in primary HF/E and health informatics journals during 2020.
Results: HF/E-focused health informatics studies included in this synthesis focused heavily on EHR customizations, specifically clinical decision support customizations and customized data displays, and on mobile health innovations. While HF/E methods aimed to jointly improve end user safety, performance, and satisfaction, most HF/E-focused health informatics studies measured only end user satisfaction.
Conclusion: HF/E-focused health informatics researchers need to identify and communicate methodological standards specific to health informatics, to better synthesize findings across resource intensive HF/E-focused health informatics studies. Important gaps in the HF/E design and evaluation process should be addressed in future work, including support for technology development platforms and training programs so that health informatics designers are as diverse as end users.
“…17 Many studies of EHR usability are limited to descriptions of UCD processes or results of usability evaluations. [18][19][20][21] Other studies of EHR usability focus on poor usability and its association with patient harm and clinician dissatisfaction. [2][3][4]6,22,23 While it is important to continue to describe the impact of poor usability, our understanding of usability is enhanced by careful descriptions of the improvements seen with corrections of usability problems.…”
Objectives Improving the usability of electronic health records (EHR) continues to be a focus of clinicians, vendors, researchers, and regulatory bodies. To understand the impact of usability redesign of an existing, site-configurable feature, we evaluated the user interface (UI) used to screen for depression, alcohol and drug misuse, fall risk, and the existence of advance directive information in ambulatory settings.
Methods As part of a quality improvement project, based on heuristic analysis, the existing UI was redesigned. Using an iterative, user-centered design process, several usability defects were corrected. Summative usability testing was performed as part of the product development and implementation cycle. Clinical quality measures reflecting rolling 12-month rates of screening were examined over 8 months prior to the implementation of the redesigned UI and 9 months after implementation.
Results Summative usability testing demonstrated improvements in task time, error rates, and System Usability Scale scores. Interrupted time series analysis demonstrated significant improvements in all screening rates after implementation of the redesigned UI compared with the original implementation.
Conclusion User-centered redesign of an existing site-specific UI may lead to significant improvements in measures of usability and quality of patient care.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.