How to improve ChatGPT performance for nephrologists: a technique guide

Miao, Jing; Thongprayoon, Charat; Craici, Iasmina M.; Cheungpasitporn, Wisit

doi:10.1007/s40620-024-01974-z

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article4

Preprint1

Relationship

Self Cite0

Independent5

Authors

Journals

Cited by 9 publications

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

How to incorporate generative artificial intelligence in nephrology fellowship education

Miao,

Thongprayoon,

Craici

et al. 2024

J Nephrol

View full text Add to dashboard Cite

How to incorporate generative artificial intelligence in nephrology fellowship education

Miao,

Thongprayoon,

Craici

et al. 2024

J Nephrol

View full text Add to dashboard Cite

ChatGPT-4o′s performance on pediatric Vesicoureteral reflux

Akyol Onder,

Ensari,

Ertan

2024

Journal of Pediatric Urology

View full text Add to dashboard Cite

Evaluation of the integration of retrieval-augmented generation in large language model for breast cancer nursing care responses

Xu,

Hong,

Zhang

et al. 2024

Sci Rep

View full text Add to dashboard Cite

Breast cancer is one of the most common malignant tumors in women worldwide. Although large language models (LLMs) can provide breast cancer nursing care consultation, inherent hallucinations can lead to inaccurate responses. Retrieval-augmented generation (RAG) technology can improve LLM performance, offering a new approach for clinical applications. In the present study, we evaluated the performance of a LLM in breast cancer nursing care using RAG technology. In the control group (GPT-4), questions were answered directly using the GPT-4 model, whereas the experimental group (RAG-GPT) used the GPT-4 model combined with RAG. A knowledge base for breast cancer nursing was created for the RAG-GPT group, and 15 of 200 real-world clinical care questions were answered randomly. The primary endpoint was overall satisfaction, and the secondary endpoints were accuracy and empathy. RAG-GPT included a curated knowledge base related to breast cancer nursing care, including textbooks, guidelines, and traditional Chinese therapy. The RAG-GPT group showed significantly higher overall satisfaction than that of the GPT-4 group (8.4 ± 0.84 vs. 5.4 ± 1.27, p < 0.01) as well as an improved accuracy of responses (8.6 ± 0.69 vs. 5.6 ± 0.96, p < 0.01). However, there was no inter-group difference in empathy (8.4 ± 0.85 vs. 7.8 ± 1.22, p > 0.05). Overall, this study revealed that RAG technology could improve LLM performance significantly, likely because of the increased accuracy of the answers without diminishing empathy. These findings provide a theoretical basis for applying RAG technology to LLMs in clinical nursing practice and education.

show abstract

How to improve ChatGPT performance for nephrologists: a technique guide

Cited by 9 publications

References 4 publications

How to incorporate generative artificial intelligence in nephrology fellowship education

How to incorporate generative artificial intelligence in nephrology fellowship education

ChatGPT-4o′s performance on pediatric Vesicoureteral reflux

Evaluation of the integration of retrieval-augmented generation in large language model for breast cancer nursing care responses

Contact Info

Product

Resources

About