The Potential Applications and Challenges of ChatGPT in the Medical Field

Mu, Yonglin; He, Dawei

doi:10.2147/ijgm.s456659

Cited by 13 publications

(1 citation statement)

References 53 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, greatly relying on such convenience may lead to various issues. The biggest disadvantage of using such systems is that students may believe in all the output content without critically analyzing its accuracy [ 27 ].…”

Section: Discussionmentioning

confidence: 99%

Expert assessment of ChatGPT’s ability to generate illness scripts: an evaluative study

Yanagita,

Yokokawa,

Fukuzawa

et al. 2024

BMC Med Educ

View full text Add to dashboard Cite

Background An illness script is a specific script format geared to represent patient-oriented clinical knowledge organized around enabling conditions, faults (i.e., pathophysiological process), and consequences. Generative artificial intelligence (AI) stands out as an educational aid in continuing medical education. The effortless creation of a typical illness script by generative AI could help the comprehension of key features of diseases and increase diagnostic accuracy. No systematic summary of specific examples of illness scripts has been reported since illness scripts are unique to each physician. Objective This study investigated whether generative AI can generate illness scripts. Methods We utilized ChatGPT-4, a generative AI, to create illness scripts for 184 diseases based on the diseases and conditions integral to the National Model Core Curriculum in Japan for undergraduate medical education (2022 revised edition) and primary care specialist training in Japan. Three physicians applied a three-tier grading scale: “A” denotes that the content of each disease’s illness script proves sufficient for training medical students, “B” denotes that it is partially lacking but acceptable, and “C” denotes that it is deficient in multiple respects. Results By leveraging ChatGPT-4, we successfully generated each component of the illness script for 184 diseases without any omission. The illness scripts received “A,” “B,” and “C” ratings of 56.0% (103/184), 28.3% (52/184), and 15.8% (29/184), respectively. Conclusion Useful illness scripts were seamlessly and instantaneously created using ChatGPT-4 by employing prompts appropriate for medical students. The technology-driven illness script is a valuable tool for introducing medical students to key features of diseases.

show abstract

Section: Discussionmentioning

confidence: 99%

Expert assessment of ChatGPT’s ability to generate illness scripts: an evaluative study

Yanagita,

Yokokawa,

Fukuzawa

et al. 2024

BMC Med Educ

View full text Add to dashboard Cite

show abstract

ChatGPT Generated Otorhinolaryngology Multiple‐Choice Questions: Quality, Psychometric Properties, and Suitability for Assessments

Lotto,

Sheppard,

Anschuetz

et al. 2024

OTO Open

View full text Add to dashboard Cite

ObjectiveTo explore Chat Generative Pretrained Transformer's (ChatGPT's) capability to create multiple‐choice questions about otorhinolaryngology (ORL).Study DesignExperimental question generation and exam simulation.SettingTertiary academic center.MethodsChatGPT 3.5 was prompted: “Can you please create a challenging 20‐question multiple‐choice questionnaire about clinical cases in otolaryngology, offering five answer options?.” The generated questionnaire was sent to medical students, residents, and consultants. Questions were investigated regarding quality criteria. Answers were anonymized and the resulting data was analyzed in terms of difficulty and internal consistency.ResultsChatGPT 3.5 generated 20 exam questions of which 1 question was considered off‐topic, 3 questions had a false answer, and 3 questions had multiple correct answers. Subspecialty theme repartition was as follows: 5 questions were on otology, 5 about rhinology, and 10 questions addressed head and neck. The qualities of focus and relevance were good while the vignette and distractor qualities were low. The level of difficulty was suitable for undergraduate medical students (n = 24), but too easy for residents (n = 30) or consultants (n = 10) in ORL. Cronbach's α was highest (.69) with 15 selected questions using students' results.ConclusionChatGPT 3.5 is able to generate grammatically correct simple ORL multiple choice questions for a medical student level. However, the overall quality of the questions was average, needing thorough review and revision by a medical expert to ensure suitability in future exams.

show abstract

Potential Use of ChatGPT for the Treatment of Infectious Diseases in Vulnerable Populations

Tao,

Liu,

Cui

et al. 2024

Ann Biomed Eng

View full text Add to dashboard Cite

The Potential Applications and Challenges of ChatGPT in the Medical Field

Cited by 13 publications

References 53 publications

Expert assessment of ChatGPT’s ability to generate illness scripts: an evaluative study

Expert assessment of ChatGPT’s ability to generate illness scripts: an evaluative study

ChatGPT Generated Otorhinolaryngology Multiple‐Choice Questions: Quality, Psychometric Properties, and Suitability for Assessments

Potential Use of ChatGPT for the Treatment of Infectious Diseases in Vulnerable Populations

Contact Info

Product

Resources

About