Guidance for Authors, Peer Reviewers, and Editors on Use of AI, Language Models, and Chatbots

Reporting Use of AI in Research and Scholarly Publication—JAMA Network Guidance

“…Over the past decade, advances in AI have enabled many innovations that facilitate rapid research and resulted in tools for disease prediction, diagnosis, and prognostication. During the last year, JAMA provided guidance to authors and peer reviewers on the transparent, appropriate, and accountable use of AI . Herein, we provide more detailed recommendations for authors and researchers.…”

Affiliation Bias in Peer Review of Abstracts by a Large Language Model

“…Ever-increasing numbers of submitted manuscripts put the academic publishing system and its human peer reviewers under pressure . Researchers have started to use large language models (LLMs) as support for writing and reviewing articles . A threat to the integrity of peer review is the influence of authors’ institutional prestige on the evaluation of their work (affiliation bias) .…”

JAMA Ophthalmology—The Year in Review, 2023

“…In 2023, 2 of the top JAMA Ophthalmology articles based on Web of Science citations (Table) involved the performance, including limitations, of an artificial intelligence (AI) chatbot for assessing ophthalmic knowledge . In response to this new tool, JAMA Ophthalmology has emphasized to reviewers not to submit confidential manuscripts, abstracts, or other text into a chatbot, language model, or similar tool, because the confidentiality no longer can be controlled by reviewers once this material becomes part of the language model’s servers . For authors, the submission of content created by AI, language models, machine learning, or similar technologies is not prohibited, but such content is generally discouraged unless it is part of the investigation’s formal research design or methods.…”