Detection and explanation of anomalies in healthcare data

Abstract

The growth of databases in the healthcare domain opens multiple doors for machine learning and artificial intelligence technology. Many medical devices are available in the medical field; however, medical errors remain a severe challenge. Different algorithms are developed to identify and solve medical errors, such as detecting anomalous readings, anomalous health conditions of a patient, etc. However, they fail to answer why those entries are considered an anomaly. This research gap leads to an outlying aspect mining problem. The problem of outlying aspect mining aims to discover the set of features (a.k.a subspace) in which the given data point is dramatically different than others. In this paper, we present a framework that detects anomalies in healthcare data and then provides an explanation of anomalies. This paper aims to effectively and efficiently detect anomalies and explain why they are considered anomalies by detecting outlying aspects. First, we re-introduced four anomaly detection techniques and outlying aspect mining algorithms. Then, we evaluate the performance of anomaly detection techniques and choose the best anomaly detection algorithm. Later, we detect the top k anomaly as a query and detect their outlying aspect. Lastly, we evaluate their performance on 16 real-world healthcare datasets. The experimental results show that the latest isolation-based outlying aspect mining measure, SiNNE, has outstanding performance on this task and has promising results.

Combating the Challenges of False Positives in AI-Driven Anomaly Detection Systems and Enhancing Data Security in the Cloud

“…Adaptive learning techniques enable anomaly detection models to continuously learn and adapt to new data, improving their accuracy in identifying anomalies. Unlike static models, which are trained once and then deployed, adaptive learning models can update their parameters over time as they encounter new data [65]. One common approach is online learning, where models are updated incrementally as new data becomes available.…”

Early warning systems for malaria outbreaks in Thailand: an anomaly detection approach

“…Anomaly detection presents a promising approach in disease detection. Previous studies have explored the application of density-based anomaly detection algorithms to health data including heart disease, diabetes, and hepatitis [ 17 , 18 ].…”

Breaking Barriers: Artificial Intelligence Interpreting the Interplay between Mental Illness and Pain as Defined by the International Association for the Study of Pain

“…Mathematical modeling can provide a more comprehensive representation of pain by integrating functional, psychological, and emotional factors into the analysis, and artificial intelligence algorithms allow researchers to analyze complex and heterogeneous data and can help identify patterns and relationships between variables, determining the relationship between low back pain and its interaction with mental illness [23][24][25][26]. Pain is a subjective experience, the evaluation of which depends largely on self-reported measures.…”