Critical Review, Development, and Testing of a Taxonomy for Adverse Events and Near Misses in the Emergency Department

Abstract

Objectives: An adverse event (AE) is a physical harm experienced by a patient due to health care, requiring intervention. Describing and categorizing AEs is important for quality and safety assessment and identifying areas for improvement. Safety science suggests that improvement efforts should focus on preventing and mitigating harm rather than on error, which is commonplace but infrequently leads to AEs. Most taxonomies fail to describe harm experienced by patients (e.g., hypoxia, hemorrhage, anaphylaxis), focusing instead on errors, and use categorizations that are too broad to be useful (e.g., "communication error"). We set out to create a patient-centered, emergency department (ED)specific framework for describing AEs and near misses to advance quality and safety in the acute care setting. Methods:We performed a critical review of existing taxonomies of harm, evaluating their applicability to the ED.We identified and adopted a classification framework and developed a taxonomy using an iterative process categorizing approximately 600 previously identified AEs and near misses. We reviewed this taxonomy with collaborators at four medical centers, receiving feedback and providing clarification. We then disseminated a set of representative scenarios for these safety experts to categorize independently using the taxonomy. We calculated interrater reliability and performance compared to our criterion standard.Results: Our search identified candidate taxonomies for detailed review. We selected the Adventist Health Systems AE taxonomy and modified this for use in the ED, adopting a framework of categories, subcategories, and up to three modifiers to further describe events. On testing, overall reviewer agreement with the criterion standard was 92% at the category level and 88% at the subcategory level. Three of the four raters concurred in 55 of 59 scenarios (93%) and all four concurred in 46 of 59 scenarios (78%). At the subcategory level, there was complete agreement in 40 of 59 (68%) scenarios and majority agreement in 55 of 59 instances (93%). Performance of individual raters ranged from very good (88%, 52/59) to near perfect (98%, 58/59) at the main category level. Conclusions:We developed a taxonomy of AEs and near misses for the ED, modified from an existing framework. Testing of the tool with minimal training yielded high performance and good inter-rater reliability. This taxonomy can be adapted and modified by EDs seeking to enhance their quality and safety reviews and characterize harm occurring in their EDs for quality improvement purposes.From the

The Emergency Department Trigger Tool: Validation and Testing to Optimize Yield

“…Data were entered using a custom Web‐based application, including AE narrative summaries, whether the event was an act of omission or commission, and event severity using the National Coordinating Council's Medication Event Reporting and Prevention (MERP) Index 31 . We used a novel taxonomy scheme of ED AEs to describe events 32 . Reported events were randomly assigned to one of two second‐level (L2) reviewers (RTG, RMS) who could agree with or modify the event, disagree and decline, mark it as duplicate, and add missed events.…”

“…31 We used a novel taxonomy scheme of ED AEs to describe events. 32 Reported events were randomly assigned to one of two secondlevel (L2) reviewers (RTG, RMS) who could agree with or modify the event, disagree and decline, mark it as duplicate, and add missed events. L2s also conducted in-depth reviews of~600 records with no AEs reported on L1 review, for an L1 false-negative rate of 7.3% in AE detection.…”

Using Community Detection Techniques to Identify Themes in COVID-19–Related Patient Safety Event Reports

“…The third challenge is reporters are often required to tag reports with a general and specific event type category (e.g., “wrong drug,” “drug confusion”) using the taxonomy integrated into their reporting system 18–20 . However, the default categories in reporting systems are challenging to interpret and differentiate—especially for complex events.…”

A Machine Learning Approach to Reclassifying Miscellaneous Patient Safety Event Reports

“…Reporters are often required to indicate the general event type (i.e., falls, blood bank) using the taxonomy integrated into their reporting system. [7][8][9] However, the usability and application of these taxonomies can be challenging, because it is difficult to classify complex events into a singular category and frontline staff who select the event type have limited knowledge of the categories because these categories are often not defined for the reporter. 3,10 These factors contribute to a large number or events being classified as "miscellaneous," which often serves as a catch-all classification and has been reported to be among the top 5 most frequently reported categories.…”