This paper aims to highlight the potential applications and limits of a large language model (LLM) in healthcare. ChatGPT is a recently developed LLM that was trained on a massive dataset of text for dialogue with users. Although AI-based language models like ChatGPT have demonstrated impressive capabilities, it is uncertain how well they will perform in real-world scenarios, particularly in fields such as medicine where high-level and complex thinking is necessary. Furthermore, while the use of ChatGPT in writing scientific articles and other scientific outputs may have potential benefits, important ethical concerns must also be addressed. Consequently, we investigated the feasibility of ChatGPT in clinical and research scenarios: (1) support of the clinical practice, (2) scientific production, (3) misuse in medicine and research, and (4) reasoning about public health topics. Results indicated that it is important to recognize and promote education on the appropriate use and potential pitfalls of AI-based LLMs in medicine.
Background
Tocilizumab blocks pro-inflammatory activity of interleukin-6 (IL-6), involved in pathogenesis of pneumonia the most frequent cause of death in COVID-19 patients.
Methods
A multicenter, single-arm, hypothesis-driven trial was planned, according to a phase 2 design, to study the effect of tocilizumab on lethality rates at 14 and 30 days (co-primary endpoints, a priori expected rates being 20 and 35%, respectively). A further prospective cohort of patients, consecutively enrolled after the first cohort was accomplished, was used as a secondary validation dataset. The two cohorts were evaluated jointly in an exploratory multivariable logistic regression model to assess prognostic variables on survival.
Results
In the primary intention-to-treat (ITT) phase 2 population, 180/301 (59.8%) subjects received tocilizumab, and 67 deaths were observed overall. Lethality rates were equal to 18.4% (97.5% CI: 13.6–24.0, P = 0.52) and 22.4% (97.5% CI: 17.2–28.3, P < 0.001) at 14 and 30 days, respectively. Lethality rates were lower in the validation dataset, that included 920 patients. No signal of specific drug toxicity was reported. In the exploratory multivariable logistic regression analysis, older age and lower PaO2/FiO2 ratio negatively affected survival, while the concurrent use of steroids was associated with greater survival. A statistically significant interaction was found between tocilizumab and respiratory support, suggesting that tocilizumab might be more effective in patients not requiring mechanical respiratory support at baseline.
Conclusions
Tocilizumab reduced lethality rate at 30 days compared with null hypothesis, without significant toxicity. Possibly, this effect could be limited to patients not requiring mechanical respiratory support at baseline.
Registration EudraCT (2020-001110-38); clinicaltrials.gov (NCT04317092).
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.