Are ChatGPT's knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study

Huh, Sun Young

doi:10.3352/jeehp.2023.20.01

Cited by 99 publications

(106 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…For instance, Gilson et al (2022) found that ChatGPT performed comparably to medical students on medical licensing exams, while de Winter (2022) reported that ChatGPT's performance on English comprehension was similar to that of university students. Conversely, Huh (2023) found that ChatGPT's overall performance on a parasitology exam was lower than that of medical students in Korea. Similarly, Geerling et al (2023) found that ChatGPT achieved high performance in a university exam measuring economics knowledge.…”

Section: Discussionmentioning

confidence: 82%

“…Additionally, AI chatbots such as ChatGPT can offer prompt feedback and corrections to questions, thereby assisting students in comprehending intricate concepts that are difficult to learn (Cotton, Cotton & Shipway, 2023). By using AI chatbots, students can benefit from personalized, interactive learning experiences, and better manage their time by planning their assignments and homework (Cotton, Cotton & Shipway, 2023;Huh, 2023;O'Connor & ChatGPT, 2023).…”

Section: Purpose Of the Studymentioning

confidence: 99%

See 1 more Smart Citation

The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course

Talan¹,

Kalinkara²

2023

Uluslararası Yönetim Bilişim Sistemleri Ve Bilgisayar Bilimleri Dergisi

View full text Add to dashboard Cite

The extensive research conducted over a prolonged period of time has resulted in the rapid advancement of artificial intelligence (AI) technology, leading to the development of numerous applications. One such recent AI application is ChatGPT, an AI chatbot that has gained millions of users in a short span of time, and can read and write texts. The aim of this study is to compare the performance of ChatGPT in an anatomy course with that of undergraduate students. The participants were students from the Faculty of Health Sciences at a state university in Turkey, who had previously taken an anatomy course. The examination was in the form of a multiple-choice test consisting of 40 items. It was found that ChatGPT outperformed the students in the examination.

show abstract

Section: Discussionmentioning

confidence: 82%

Section: Purpose Of the Studymentioning

confidence: 99%

The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course

Talan¹,

Kalinkara²

2023

Uluslararası Yönetim Bilişim Sistemleri Ve Bilgisayar Bilimleri Dergisi

View full text Add to dashboard Cite

show abstract

“…Scientists must be able to assess the correctness of AI-generated medical information and develop credibly, validated information for patients and the general public [ 4 , 7 ]. As a result, it is vital to establish the precision with which ChatGPT, a recently built AI chatbot, can answer queries.…”

Section: Introductionmentioning

confidence: 99%

“…As a result, it is vital to establish the precision with which ChatGPT, a recently built AI chatbot, can answer queries. This comparison of ChatGPT's capabilities may shed light on whether and how scientists and users could benefit from ChatGPT for learning and research purposes [ 4 , 7 ].…”

Section: Introductionmentioning

confidence: 99%

“…This conversational system which was constructed and trained by OpenAI is based on GPT-3 (Generative Pretrained Transformer 3) and can be viewed as a gigantic language model [1]. ChatGPT displays a remarkable competency in natural language text understanding and generation [4][5][6][7]. The machine learning model in ChatGPT is leveraged by reinforcement learning from human feedback [1].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

ChatGPT Output Regarding Compulsory Vaccination and COVID-19 Vaccine Conspiracy: A Descriptive Study at the Outset of a Paradigm Shift in Online Search for Information

Sallam¹,

Salim²,

Barakat³

et al. 2023

Cureus

View full text Add to dashboard Cite

Background: Being on the verge of a revolutionary approach to gathering information, ChatGPT (an artificial intelligence (AI)-based language model developed by OpenAI, and capable of producing human-like text) could be the prime motive of a paradigm shift on how humans will acquire information. Despite the concerns related to the use of such a promising tool in relation to the future of the quality of education, this technology will soon be incorporated into web search engines mandating the need to evaluate the output of such a tool. Previous studies showed that dependence on some sources of online information (e.g., social media platforms) was associated with higher rates of vaccination hesitancy. Therefore, the aim of the current study was to describe the output of ChatGPT regarding coronavirus disease 2019 (COVID-19) vaccine conspiracy beliefs. and compulsory vaccination. Methods: The current descriptive study was conducted on January 14, 2023 using the ChatGPT from OpenAI (OpenAI, L.L.C., San Francisco, CA, USA). The output was evaluated by two authors and the degree of agreement regarding the correctness, clarity, conciseness, and bias was evaluated using Cohen’s kappa. Results: The ChatGPT responses were dismissive of conspiratorial ideas about severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) origins labeling it as non-credible and lacking scientific evidence. Additionally, ChatGPT responses were totally against COVID-19 vaccine conspiracy statements. Regarding compulsory vaccination, ChatGPT responses were neutral citing the following as advantages of this strategy: protecting public health, maintaining herd immunity, reducing the spread of disease, cost-effectiveness, and legal obligation, and on the other hand, it cited the following as disadvantages of compulsory vaccination: ethical and legal concerns, mistrust and resistance, logistical challenges, and limited resources and knowledge. Conclusions: The current study showed that ChatGPT could be a source of information to challenge COVID-19 vaccine conspiracies. For compulsory vaccination, ChatGPT resonated with the divided opinion in the scientific community toward such a strategy; nevertheless, it detailed the pros and cons of this approach. As it currently stands, the judicious use of ChatGPT could be utilized as a user-friendly source of COVID-19 vaccine information that could challenge conspiracy ideas with clear, concise, and non-biased content. However, ChatGPT content cannot be used as an alternative to the original reliable sources of vaccine information (e.g., the World Health Organization [WHO] and the Centers for Disease Control and Prevention [CDC]).

show abstract

Artificial Intelligence in Ecology: A Commentary on a Chatbot's Perspective

Haghighi

Saqalaksari

Johnson

2023

Bulletin Ecologic Soc America

View full text Add to dashboard Cite

The potential of artificial intelligence (AI) to shape research and education is a highly topical issue. The recent release of ChatGPT (Chat Generative Pre‐trained Transformer) by OpenAI on November 30, 2022 has opened up new possibilities for the use of chatbot services in ecological research and education. In this perspective article, we address associated contemporary topics including the use of chatbot services in ecology education and academic writing, the application of AI in ecology, the potential environmental impact, and ethical considerations of using such services. Several logistical, ethical and environmental factors were identified that should be considered in the context of ecological research. We argue that ChatGPT can help reduce the workload of researchers, generate new insights and ideas, and serve as a personal instructor and assistant for students. While we show how AI chatbots have the potential to be useful assets for ecologists, several challenges arose. AI in ecological research includes the limited ability of AI algorithms to capture complexity and nuance, the dependence of AI models on data quality, and ethical concerns about the use of AI in research. The construction and operation of such services also have potential environmental impacts but may also provide environmental benefits in comparison with other conventional approaches, all of which should be evaluated. Despite these limitations and challenges, we consider that the use of AI can be a valuable tool in ecological research and could enhance the speed and efficiency of research by automating certain tasks (e.g. data collection and management) and analyzing large amounts of data. However, we emphasize the importance of taking a responsible, sustainable and transparent approach to using chatbot services and AI in ecological research and education, while remaining mindful of the potential impact on the environment, society, and ethical concerns.

show abstract

Are ChatGPT's knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study

Cited by 99 publications

References 4 publications

The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course

The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course

ChatGPT Output Regarding Compulsory Vaccination and COVID-19 Vaccine Conspiracy: A Descriptive Study at the Outset of a Paradigm Shift in Online Search for Information

Artificial Intelligence in Ecology: A Commentary on a Chatbot's Perspective

Contact Info

Product

Resources

About