Machine Learning Approach for Active Vaccine Safety Monitoring

Abstract

Background Vaccine safety surveillance is important because it is related to vaccine hesitancy, which affects vaccination rate. To increase confidence in vaccination, the active monitoring of vaccine adverse events is important. For effective active surveillance, we developed and verified a machine learning-based active surveillance system using national claim data. Methods We used two databases, one from the Korea Disease Control and Prevention Agency, which contains flu vaccination records for the elderly, and another from the National Health Insurance Service, which contains the claim data of vaccinated people. We developed a case-crossover design based machine learning model to predict the health outcome of interest events (anaphylaxis and agranulocytosis) using a random forest. Feature importance values were evaluated to determine candidate associations with each outcome. We investigated the relationship of the features to each event via a literature review, comparison with the Side Effect Resource, and using the Local Interpretable Model-agnostic Explanation method. Results The trained model predicted each health outcome of interest with a high accuracy (approximately 70%). We found literature supporting our results, and most of the important drug-related features were listed in the Side Effect Resource database as inducing the health outcome of interest. For anaphylaxis, flu vaccination ranked high in our feature importance analysis and had a positive association in Local Interpretable Model-Agnostic Explanation analysis. Although the feature importance of vaccination was lower for agranulocytosis, it also had a positive relationship in the Local Interpretable Model-Agnostic Explanation analysis. Conclusion We developed a machine learning-based active surveillance system for detecting possible factors that can induce adverse events using health claim and vaccination databases. The results of the study demonstrated a potentially useful application of two linked national health record databases. Our model can contribute to the establishment of a system for conducting active surveillance on vaccination.

Applying Artificial Intelligence in Structured Real-World Data for Pharmacovigilance Purposes: A Systematic Literature Review (Preprint)

“…In terms of PV, explainable AI models on RWD could bring evidence about unknown confounders in an ADR and they could provide more informative results for PV experts about the causes of a potential PV signal. Although XAI methods' results are tested extensively in the healthcare domain, we found only 6 recent studies that were applied in the PV domain [16,18,22,23,49,51] (2 in 2021, 2 in 2022, and 2 in 2023). Another novel approach that is discussed extensively in the explainability field is the newly introduced causal machine/deep learning (CML/CDL).…”

Generating structural alerts from toxicology datasets using the local interpretable model-agnostic explanations method

“…1,2 Studies already point out the importance of computational toxicology as a tool for the future of environmental health sciences and regulatory decisions in public health. 3,4 In fact, this tool combined with machine learning has a range of applications in many areas of science such as pharmacology, [5][6][7][8][9][10] genetics and biochemistry, [11][12][13][14][15] and drug discovery for COVID-19. 16 However, the model explainability in machine learning is a highly essential issue [17][18][19][20][21] because machine learning models are mostly considered as black boxes, 17,[21][22][23][24] indicating an ambitious challenge to the progress of machine learning.…”