The accuracy of artificial intelligence in predicting COVID-19 patient mortality: a systematic review and meta-analysis

Abstract

Background The purpose of this paper was to systematically evaluate the application value of artificial intelligence in predicting mortality among COVID-19 patients. Methods The PubMed, Embase, Web of Science, CNKI, Wanfang, China Biomedical Literature, and VIP databases were systematically searched from inception to October 2022 to identify studies that evaluated the predictive effects of artificial intelligence on mortality among COVID-19 patients. The retrieved literature was screened according to the inclusion and exclusion criteria. The quality of the included studies was assessed using the QUADAS-2 tools. Statistical analysis of the included studies was performed using Review Manager 5.3, Stata 16.0, and Meta-DiSc 1.4 statistical software. This meta-analysis was registered in PROSPERO (CRD42022315158). Findings Of 2193 studies, 23 studies involving a total of 25 AI models met the inclusion criteria. Among them, 18 studies explicitly mentioned training and test sets, and 5 studies did not explicitly mention grouping. In the training set, the pooled sensitivity was 0.93 [0.87, 0.96], the pooled specificity was 0.94 [0.87, 0.97], and the area under the ROC curve was 0.98 [0.96, 0.99]. In the validation set, the pooled sensitivity was 0.84 [0.78, 0.88], the pooled specificity was 0.89 [0.85, 0.92], and the area under the ROC curve was 0.93 [1.00, 0.00]. In the subgroup analysis, the areas under the summary receiver operating characteristic (SROC) curves of the artificial intelligence models KNN, SVM, ANN, RF and XGBoost were 0.98, 0.98, 0.94, 0.92, and 0.91, respectively. The Deeks funnel plot indicated that there was no significant publication bias in this study (P > 0.05). Interpretation Artificial intelligence models have high accuracy in predicting mortality among COVID-19 patients and have high prognostic value. Among them, the KNN, SVM, ANN, RF, XGBoost, and other models have the highest levels of accuracy.

Evaluating the Performance of Artificial Intelligence in Generating Differential Diagnoses for Infectious Diseases Cases: A Comparative Study of Large Language Models

“…[1] Furthermore, AI models have been instrumental in enhancing the diagnostic processes during the COVID-19 pandemic by accurately identifying and predicting disease severity. [2, 3]…”

“…[1] Furthermore, AI models have been instrumental in enhancing the diagnostic processes during the COVID-19 pandemic by accurately identifying and predicting disease severity. [2,3] The use of large language models (LLMs) such as GPT 4, Llama 3, and Gemini 1.5 in generating differential diagnoses represents a significant leap in AI capabilities. While GPT 4 and Gemini 1.5 are proprietary LLMs developed by OpenAI and Google respectively, Llama 3 is an open-source model developed by Meta.…”

Mapping the Heartbeat of America with ChatGPT-4: Unpacking the Interplay of Social Vulnerability, Digital Literacy, and Cardiovascular Mortality in County Residency Choices

“…AI tools could also play a big role in identifying high-risk populations for hospital injury and guide interventions and preventive actions to improve patient safety [6]. Recent applications of AI in this domain have been in predicting hospitalizations and determining the mortality associated with COVID-19 [7,8]. The prospects and benefits of AI and machine learning use are well recognized and accepted in healthcare today concerning disease diagnosis, risk assessment associated with morbidity and mortality, surveillance of infectious diseases and outbreak prediction, and policy implications [8][9][10].…”