The Use of Artificial Intelligence in Writing Scientific Review Articles

Kacena, Melissa A.; Plotkin, Lilian I.; Fehrenbacher, Jill C.

doi:10.1007/s11914-023-00852-0

Cited by 44 publications

(3 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The original goal was to have a total of 9 review articles and quantifiable data related to each step of the processes to assess the benefits and limitations of each approach. Please refer to the Introductory Comment [ 12 ] for more information regarding the specifics of the study design. We had several hypotheses for this experiment.…”

Section: Introductionmentioning

confidence: 99%

The Utility of AI in Writing a Scientific Review Article on the Impacts of COVID-19 on Musculoskeletal Health

Awosanya,

Harris,

Creecy

et al. 2024

Curr Osteoporos Rep

Self Cite

View full text Add to dashboard Cite

Purpose of Review There were two primary purposes to our reviews. First, to provide an update to the scientific community about the impacts of COVID-19 on musculoskeletal health. Second, was to determine the value of using a large language model, ChatGPT 4.0, in the process of writing a scientific review article. To accomplish these objectives, we originally set out to write three review articles on the topic using different methods to produce the initial drafts of the review articles. The first review article was written in the traditional manner by humans, the second was to be written exclusively using ChatGPT (AI-only or AIO), and the third approach was to input the outline and references selected by humans from approach 1 into ChatGPT, using the AI to assist in completing the writing (AI-assisted or AIA). All review articles were extensively fact-checked and edited by all co-authors leading to the final drafts of the manuscripts, which were significantly different from the initial drafts. Recent Findings Unfortunately, during this process, it became clear that approach 2 was not feasible for a very recent topic like COVID-19 as at the time, ChatGPT 4.0 had a cutoff date of September 2021 and all articles published after this date had to be provided to ChatGPT, making approaches 2 and 3 virtually identical. Therefore, only two approaches and two review articles were written (human and AI-assisted). Here we found that the human-only approach took less time to complete than the AI-assisted approach. This was largely due to the number of hours required to fact-check and edit the AI-assisted manuscript. Of note, the AI-assisted approach resulted in inaccurate attributions of references (about 20%) and had a higher similarity index suggesting an increased risk of plagiarism. Summary The main aim of this project was to determine whether the use of AI could improve the process of writing a scientific review article. Based on our experience, with the current state of technology, it would not be advised to solely use AI to write a scientific review article, especially on a recent topic.

show abstract

Section: Introductionmentioning

confidence: 99%

The Utility of AI in Writing a Scientific Review Article on the Impacts of COVID-19 on Musculoskeletal Health

Awosanya,

Harris,

Creecy

et al. 2024

Curr Osteoporos Rep

Self Cite

View full text Add to dashboard Cite

show abstract

“…This is one of many articles evaluating the utility of using AI to write scientific review articles on musculoskeletal topics [ 1 ]. The first draft of this review was written entirely by humans.…”

Section: Introductionmentioning

confidence: 99%

Do Not Lose Your Nerve, Be Callus: Insights Into Neural Regulation of Fracture Healing

Nazzal,

Morris,

Parker

et al. 2024

Curr Osteoporos Rep

Self Cite

View full text Add to dashboard Cite

Purpose of Review Fractures are a prominent form of traumatic injury and shall continue to be for the foreseeable future. While the inflammatory response and the cells of the bone marrow microenvironment play significant roles in fracture healing, the nervous system is also an important player in regulating bone healing. Recent Findings Considerable evidence demonstrates a role for nervous system regulation of fracture healing in a setting of traumatic injury to the brain. Although many of the impacts of the nervous system on fracture healing are positive, pain mediated by the nervous system can have detrimental effects on mobilization and quality of life. Summary Understanding the role the nervous system plays in fracture healing is vital to understanding fracture healing as a whole and improving quality of life post-injury. This review article is part of a series of multiple manuscripts designed to determine the utility of using artificial intelligence for writing scientific reviews.

show abstract

“…4 Furthermore, research assessing the AI software currently available has verified LLMs' generation of hallucinations and inaccurate information. Kacena et al 6 constructed a study comparing 3 methods of writing a scientific manuscript: human only, chatbot only, and an integration of the 2 methods. When using chatbot alone, up to 70% of the cited references were inaccurate.…”

mentioning

confidence: 99%