Let's Chat About Chatbots: Additional Thoughts on ChatGPT and Its Role in Plastic Surgery Along With Its Ability to Perform Systematic Reviews

Najafali, Daniel; Reiche, Erik; Camacho, Justin M; Morrison, Shane D; Dorafshar, Amir H.

doi:10.1093/asj/sjad056

Cited by 37 publications

(33 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is not unexpected that the majority of shortlisted papers fall into the Level 1 and Level 2 category. As seen from Table 1, most of Level 1 and Level 2 papers are short editorial comments or letters to the editor from multidisciplinary journals like Nature (https://www.nature.com/) and Science (https://www.science.org/), or speciality journals like nuclear medicine [3, 59], plastic surgery [79, 38], syn-thetic biology [106] and orthopaedic [81]. These publications usually deliver high-level comments about the potential impact and pitfalls of ChatGPT in healthcare [113], with a focus on medical publishing.…”

Section: Methodsmentioning

confidence: 99%

ChatGPT in Healthcare: A Taxonomy and Systematic Review

Li¹,

Amin²,

Kleesiek³

et al. 2023

Preprint

View full text Add to dashboard Cite

The recent release of ChatGPT, a chat bot research project/product of natural language processing (NLP) by OpenAI, stirs up a sensation among both the general public and medical professionals, amassing a phenomenally large user base in a short time. This is a typical example of the 'productization' of cutting-edge technologies, which allows the general public without a technical background to gain firsthand experience in artificial intelligence (AI), similar to the AI hype created by AlphaGo (DeepMind Technologies, UK) and self-driving cars (Google, Tesla, etc.). However, it is crucial, especially for healthcare researchers, to remain prudent amidst the hype. This work provides a systematic review of existing publications on the use of ChatGPT in healthcare, elucidating the 'status quo' of ChatGPT in medical applications, for general readers, healthcare professionals as well as NLP scientists. The large biomedical literature databasePubMedis used to retrieve published works on this topic using the keyword 'ChatGPT'. An inclusion criterion and a taxonomy are further proposed to filter the search results and categorize the selected publications, respectively. It is found through the review that the current release of ChatGPT has achieved only moderate or 'passing' performance in a variety of tests, and is unreliable for actual clinical deployment, since it is not intended for clinical applications by design. We conclude that specialized NLP models trained on (bio)medical datasets still represent the right direction to pursue for critical clinical applications.

show abstract

Section: Methodsmentioning

confidence: 99%

ChatGPT in Healthcare: A Taxonomy and Systematic Review

Li¹,

Amin²,

Kleesiek³

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…However, it is primarily limited to generating ideas and cannot properly execute a full systematic review. 16 Nonetheless, researchers’ expertise and data interpretation abilities should not be replaced by ChatGPT-4. Therefore, researchers must evaluate ChatGPT-4’s use and ensure that it aligns with best research practices.…”

Section: Role Of Chatgpt-4 In Plastic Surgerymentioning

confidence: 99%

“…6 Recent research studies have suggested that ChatGPT-4 can be the game-changer among plastic surgeons due to its high outpatient consultation capacity, 3 generation of new surgical ideas, 7 and improvement of the reconstructive and plastic surgery research landscape. 6 Besides, the AI language model can enhance the training of plastic surgeons by improving their Plastic Surgery In-Service Training Examination score, 2 enhancing their competency and efficiency during the surgical process. ChatGPT-4, the fourth iteration of the Generative Pre-trained Transformer series, marks an important milestone in the field of natural language processing and artificial intelligence.…”

Section: Introductionmentioning

confidence: 99%

Utilization of ChatGPT-4 in Plastic and Reconstructive Surgery: A Narrative Review

Aljindan,

Shawosh,

Altamimi

et al. 2023

Plastic and Reconstructive Surgery - Global Open

View full text Add to dashboard Cite

Background: ChatGPT-4 (Chat Generative Pre-Trained Transformer) has demonstrated remarkable capabilities in natural language processing and understanding, making it a promising tool for various medical domains. This article presents a comprehensive overview of the potential applications of ChatGPT-4, a cutting-edge language model developed by OpenAI, in the field of plastic and reconstructive surgery. Methods: After conducting a thorough literature review, we discovered pertinent articles that explore the application of ChatGPT-4 in plastic surgery. By examining these findings and integrating the information with our personal experience using ChatGPT-4 in the field of plastic surgery, we have produced an all-encompassing narrative review. Results: The narrative review focuses on three main areas: clinical applications, research applications, and medical education. In the clinical realm, ChatGPT-4 has the potential to streamline documentation processes, improve communication, and enhance personalized patient care. It can assist in generating accurate and comprehensive progress notes, operative notes, surgical consent forms, on-call schedules, and consultation reports. However, it is important to note that ChatGPT-4 should be used as a supportive tool and should not replace human doctors. Conclusions: The potential applications of ChatGPT-4 in plastic and reconstructive surgery are vast and promising. This technology has the potential to revolutionize documentation, research, and medical education in the field. However, it is crucial to integrate this tool responsibly, considering its limitations and ensuring that human expertise remains paramount.

show abstract

“…2 In the domain of plastic surgery, advanced language models like GPT-4 have been used to expose topics for systematic reviews that have not been published yet and to test their research efficacy in breast reconstruction. [3][4][5][6] Recently, Sun et al published how GPT-4 could act as a consultant in cosmetic surgery. 7 However, studies that exploit the capabilities of GPT-4 and test it in addressing complex clinical questions are still lacking.…”

Section: Introductionmentioning

confidence: 99%

Can AI Think Like a Plastic Surgeon? Evaluating GPT-4’s Clinical Judgment in Reconstructive Procedures of the Upper Extremity

Leypold,

Schäfer,

Boos

et al. 2023

Plastic and Reconstructive Surgery - Global Open

View full text Add to dashboard Cite

Summary: This study delves into the potential application of OpenAI’s Generative Pretrained Transformer 4 (GPT-4) in plastic surgery, with a particular focus on procedures involving the hand and arm. GPT-4, a cutting-edge artificial intelligence (AI) model known for its advanced chat interface, was tested on nine surgical scenarios of varying complexity. To optimize the performance of GPT-4, prompt engineering techniques were used to guide the model’s responses and improve the relevance and accuracy of its output. A panel of expert plastic surgeons evaluated the responses using a Likert scale to assess the model’s performance, based on five distinct criteria. Each criterion was scored on a scale of 1 to 5, with 5 representing the highest possible score. GPT-4 demonstrated a high level of performance, achieving an average score of 4.34 across all cases, consistent across different complexities. The study highlights the ability of GPT-4 to understand and respond to complicated surgical scenarios. However, the study also identifies potential areas for improvement. These include refining the prompts used to elicit responses from the model and providing targeted training with specialized, up-to-date sources. This study demonstrates a new approach to exploring large language models and highlights potential future applications of AI. These could improve patient care, refine surgical outcomes, and even change the way we approach complex clinical scenarios in plastic surgery. However, the intrinsic limitations of AI in its current state, together with the potential ethical considerations and the inherent uncertainty of unanticipated issues, serve to reiterate the indispensable role and unparalleled value of human plastic surgeons.

show abstract

Let's Chat About Chatbots: Additional Thoughts on ChatGPT and Its Role in Plastic Surgery Along With Its Ability to Perform Systematic Reviews

Cited by 37 publications

References 5 publications

ChatGPT in Healthcare: A Taxonomy and Systematic Review

ChatGPT in Healthcare: A Taxonomy and Systematic Review

Utilization of ChatGPT-4 in Plastic and Reconstructive Surgery: A Narrative Review

Can AI Think Like a Plastic Surgeon? Evaluating GPT-4’s Clinical Judgment in Reconstructive Procedures of the Upper Extremity

Contact Info

Product

Resources

About