The rise of artificial intelligence-driven health communication

Golan, Roei; Reddy, Rohit; Ramasamy, Ranjith

doi:10.21037/tau-23-556

Cited by 4 publications

(1 citation statement)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…LLM-driven chatbots can be engaged directly in conversation, allowing users to ask them questions or issue other commands. Since LLMs are trained on large amounts of text data, including encyclopedic resources, they can also answer questions reliably and factually [ 1 ]. This ability has allowed them to serve as a source for medical inquiries, with the possibility of replacing popular search engines such as Google [ 1 ].…”

Section: Introductionmentioning

confidence: 99%

Assessing the Readability of Patient Education Materials on Cardiac Catheterization From Artificial Intelligence Chatbots: An Observational Cross-Sectional Study

Behers,

Vargas,

Behers

et al. 2024

Cureus

View full text Add to dashboard Cite

Background: Artificial intelligence (AI) is a burgeoning new field that has increased in popularity over the past couple of years, coinciding with the public release of large language model (LLM)-driven chatbots. These chatbots, such as ChatGPT, can be engaged directly in conversation, allowing users to ask them questions or issue other commands. Since LLMs are trained on large amounts of text data, they can also answer questions reliably and factually, an ability that has allowed them to serve as a source for medical inquiries. This study seeks to assess the readability of patient education materials on cardiac catheterization across four of the most common chatbots: ChatGPT, Microsoft Copilot, Google Gemini, and Meta AI. Methodology: A set of 10 questions regarding cardiac catheterization was developed using website-based patient education materials on the topic. We then asked these questions in consecutive order to four of the most common chatbots: ChatGPT, Microsoft Copilot, Google Gemini, and Meta AI. The Flesch Reading Ease Score (FRES) was used to assess the readability score. Readability grade levels were assessed using six tools: Flesch-Kincaid Grade Level (FKGL), Gunning Fog Index (GFI), Coleman-Liau Index (CLI), Simple Measure of Gobbledygook (SMOG) Index, Automated Readability Index (ARI), and FORCAST Grade Level. Results: The mean FRES across all four chatbots was 40.2, while overall mean grade levels for the four chatbots were 11.2, 13.7, 13.7, 13.3, 11.2, and 11.6 across the FKGL, GFI, CLI, SMOG, ARI, and FORCAST indices, respectively. Mean reading grade levels across the six tools were 14.8 for ChatGPT, 12.3 for Microsoft Copilot, 13.1 for Google Gemini, and 9.6 for Meta AI. Further, FRES values for the four chatbots were 31, 35.8, 36.4, and 57.7, respectively. Conclusions: This study shows that AI chatbots are capable of providing answers to medical questions regarding cardiac catheterization. However, the responses across the four chatbots had overall mean reading grade levels at the 11 th -13 th -grade level, depending on the tool used. This means that the materials were at the high school and even college reading level, which far exceeds the recommended sixth-grade level for patient education materials. Further, there is significant variability in the readability levels provided by different chatbots as, across all six grade-level assessments, Meta AI had the lowest scores and ChatGPT generally had the highest.

show abstract

Section: Introductionmentioning

confidence: 99%

Assessing the Readability of Patient Education Materials on Cardiac Catheterization From Artificial Intelligence Chatbots: An Observational Cross-Sectional Study

Behers,

Vargas,

Behers

et al. 2024

Cureus

View full text Add to dashboard Cite

show abstract

Thinking machines: artificial intelligence in rehabilitation and beyond

Polastri

2024

International Journal of Therapy and Rehabilitation

View full text Add to dashboard Cite

show abstract

The Use of Artificial Intelligence in Health Communication

Tanyildizi,

Yıldız

2024

Advances in Medical Technologies and Clinical Practice

View full text Add to dashboard Cite

Communication is of great importance in health services. Nowadays, new media, especially the internet, are frequently used in health communication. Artificial intelligence has also begun to be used in healthcare. Artificial intelligence studies generally aim to develop artificial methods that imitate human ways of thinking. In addition, it is predicted that some programs produced based on artificial intelligence will affect health communication processes in daily use. The most important of these programs is the ChatGPT (Chatbot Generative Pre-trained Transformer) program. The purpose of this study is to reveal the benefits and drawbacks of using the ChatGPT program in health communication by providing a qualitative framework. For this purpose, a semi-structured interview was conducted with 30 people over the age of 18, determined by a purposeful sampling method. In line with the data obtained, the use of Chat GPT in health communication was tried to be explained.

show abstract

The rise of artificial intelligence-driven health communication

Cited by 4 publications

References 11 publications

Assessing the Readability of Patient Education Materials on Cardiac Catheterization From Artificial Intelligence Chatbots: An Observational Cross-Sectional Study

Assessing the Readability of Patient Education Materials on Cardiac Catheterization From Artificial Intelligence Chatbots: An Observational Cross-Sectional Study

Thinking machines: artificial intelligence in rehabilitation and beyond

The Use of Artificial Intelligence in Health Communication

Contact Info

Product

Resources

About