Irène Buvat and Ken Herrmann Talk with Alexander Stremitzer, Kevin Tobia, and Aileen Nielsen

Buvat, Irène; Herrmann, Ken; Stremitzer, Alexander; Tobia, Kevin; Nielsen, Aileen

doi:10.2967/jnumed.120.260505

Cited by 5 publications

(5 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We focused on the most common PET/CT tracer and on indications with a relatively large database of information available to GPT-4. The responses might be less helpful or reliable in the case of rare indications or new tracers, especially if the relevant literature has been published after the model training threshold (GPT-4: September 2021) (6). Validation in other contexts will therefore be required.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

ChatGPT: Can You Prepare My Patients for [¹⁸F]FDG PET/CT and Explain My Reports?

Rogasch,

Metzger,

Preisler

et al. 2023

J Nucl Med

View full text Add to dashboard Cite

We evaluated whether the artificial intelligence chatbot ChatGPT can adequately answer patient questions related to [ 18 F]FDG PET/CT in common clinical indications before and after scanning. Methods: Thirteen questions regarding [ 18 F]FDG PET/CT were submitted to ChatGPT. ChatGPT was also asked to explain 6 PET/CT reports (lung cancer, Hodgkin lymphoma) and answer 6 follow-up questions (e.g., on tumor stage or recommended treatment). To be rated "useful" or "appropriate," a response had to be adequate by the standards of the nuclear medicine staff. Inconsistency was assessed by regenerating responses. Results: Responses were rated "appropriate" for 92% of 25 tasks and "useful" for 96%. Considerable inconsistencies were found between regenerated responses for 16% of tasks. Responses to 83% of sensitive questions (e.g., staging/treatment options) were rated "empathetic." Conclusion: ChatGPT might adequately substitute for advice given to patients by nuclear medicine staff in the investigated settings. Improving the consistency of ChatGPT would further increase reliability.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Within the discipline of nuclear medicine, Buvat and Weber recently reported a brief interview with the AI chatbot ChatGPT. While remaining cautious in providing recommendations or solutions, they found that ChatGPT could answer technical questions well (6). It is neither foreseeable nor desirable that AI tools will replace physicians for informed consent.…”

mentioning

confidence: 99%

ChatGPT: Can You Prepare My Patients for [¹⁸F]FDG PET/CT and Explain My Reports?

Rogasch,

Metzger,

Preisler

et al. 2023

J Nucl Med

View full text Add to dashboard Cite

show abstract

“…ChatGPT's capabilities extend to facilitating patient management [16]. Providing dosage guidelines and vital information regarding potential side effects, drug interactions, and other essential factors is another way ChatGPT can assist urology [17].…”

Section: Introductionmentioning

confidence: 99%

The efficacy of artificial intelligence in urology: a detailed analysis of kidney stone-related queries

Cil,

Dogan

2024

World J Urol

View full text Add to dashboard Cite

Purpose The study aimed to assess the efficacy of OpenAI's advanced AI model, ChatGPT, in diagnosing urological conditions, focusing on kidney stones. Materials and methods A set of 90 structured questions, compliant with EAU Guidelines 2023, was curated by seasoned urologists for this investigation. We evaluated ChatGPT's performance based on the accuracy and completeness of its responses to two types of questions [binary (true/false) and descriptive (multiple-choice)], stratified into difficulty levels: easy, moderate, and complex. Furthermore, we analyzed the model's learning and adaptability capacity by reassessing the initially incorrect responses after a 2 week interval. Results The model demonstrated commendable accuracy, correctly answering 80% of binary questions (n:45) and 93.3% of descriptive questions (n:45). The model's performance showed no significant variation across different question difficulty levels, with p-values of 0.548 for accuracy and 0.417 for completeness, respectively. Upon reassessment of initially 12 incorrect responses (9 binary to 3 descriptive) after two weeks, ChatGPT's accuracy showed substantial improvement. The mean accuracy score significantly increased from 1.58 ± 0.51 to 2.83 ± 0.93 (p = 0.004), underlining the model's ability to learn and adapt over time. Conclusion These findings highlight the potential of ChatGPT in urological diagnostics, but also underscore areas requiring enhancement, especially in the completeness of responses to complex queries. The study endorses AI's incorporation into healthcare, while advocating for prudence and professional supervision in its application.

show abstract

“…ChatGPT enables rapid processing of complex information and its potential applications in clinical radiology routines have been extensively explored and published in preprints. These comprise the preparation of radiological reports 18 , transferring radiological reports into plain language by simplifying them 19,20 , or providing clinical decision support on differential diagnoses, diagnostic procedures, final diagnosis, and treatment 21 .…”

Section: Introductionmentioning

confidence: 99%

A Context-based Chatbot Surpasses Radiologists and Generic ChatGPT in Following the ACR Appropriateness Guidelines

Rau,

Zöller

et al. 2023

Radiology

View full text Add to dashboard Cite

BackgroundRadiological imaging guidelines are crucial for accurate diagnosis and optimal patient care as they result in standardized procedures and thus reduce inappropriate imaging studies. In the present study, we investigated the potential to support clinical decision-making using an interactive chatbot designed to provide personalized imaging recommendations based on indexed and vectorized American College of Radiology (ACR) appropriateness criteria documents. MethodsWe utilized 209 ACR appropriateness criteria documents as specialized knowledge base and employed LlamaIndex and the ChatGPT 3.5-Turbo to create an appropriateness criteria contexted chatbot (accGPT). Fifty clinical case files were used to compare the accGPT`s performance against radiologists at varying experience levels and to generic ChatGPT 3.5 and 4.0. ResultsAll chatbots reached at least human performance level. For the 50 case files, the accGPT provided a median of 83% (95% CI 82-84) `usually appropriate` recommendations, while radiologists provided a median of 66% (95% CI 62-70). GPT 3.5-Turbo 70% (95% CI 67-73) and GPT 4 79% (95% CI 76-81) correct answers. Consistency was highest for the accGPT with almost perfect Fleiss` Kappa of 0.82. Further, the chatbots provided substantial time and cost savings, with an average decision time of 5 minutes and a cost of 0.19 Euro for all cases, compared to 50 minutes and 29.99 Euro for radiologists (both p < 0.01). ConclusionChatGPT-based algorithms have the potential to substantially improve the decision-making for clinical imaging studies in accordance with ACR guidelines. Specifically, a context-based algorithm performed superior to its generic counterpart, demonstrating the value of tailoring AI solutions to specific healthcare applications.

show abstract

Irène Buvat and Ken Herrmann Talk with Alexander Stremitzer, Kevin Tobia, and Aileen Nielsen

Cited by 5 publications

References 0 publications

ChatGPT: Can You Prepare My Patients for [¹⁸F]FDG PET/CT and Explain My Reports?

ChatGPT: Can You Prepare My Patients for [¹⁸F]FDG PET/CT and Explain My Reports?

The efficacy of artificial intelligence in urology: a detailed analysis of kidney stone-related queries

A Context-based Chatbot Surpasses Radiologists and Generic ChatGPT in Following the ACR Appropriateness Guidelines

Contact Info

Product

Resources

About

Irène Buvat and Ken Herrmann Talk with Alexander Stremitzer, Kevin Tobia, and Aileen Nielsen

Cited by 5 publications

References 0 publications

ChatGPT: Can You Prepare My Patients for [18F]FDG PET/CT and Explain My Reports?

ChatGPT: Can You Prepare My Patients for [18F]FDG PET/CT and Explain My Reports?

The efficacy of artificial intelligence in urology: a detailed analysis of kidney stone-related queries

A Context-based Chatbot Surpasses Radiologists and Generic ChatGPT in Following the ACR Appropriateness Guidelines

Contact Info

Product

Resources

About

ChatGPT: Can You Prepare My Patients for [¹⁸F]FDG PET/CT and Explain My Reports?

ChatGPT: Can You Prepare My Patients for [¹⁸F]FDG PET/CT and Explain My Reports?