Can Patients With Urogenital Cancer Rely on Artificial Intelligence Chatbots for Treatment Decisions?


Erkan A., KOÇ A., Barali D., Satir A., Zengin S., TÜRKOĞLU A. R., ...Daha Fazla

Clinical Genitourinary Cancer, cilt.22, sa.6, 2024 (SCI-Expanded, Scopus)

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 22 Sayı: 6
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1016/j.clgc.2024.102206
  • Dergi Adı: Clinical Genitourinary Cancer
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Anahtar Kelimeler: Artificial Intelligence, ChatGPT, Quality assessment, Treatment, Urogenital neoplasms
  • Sağlık Bilimleri Üniversitesi Adresli: Evet

Özet

Objectives: In the era of artificial intelligence, almost half of the patients use the internet to get information about their diseases. Our study aims to demonstrate the reliability of the information provided by artificial intelligence chatbots (AICs) about urogenital cancer treatments. Methods: The most frequently searched keyword about prostate, bladder, kidney, and testicular cancer treatment via Google Trends was asked to 3 different AICs (ChatGPT, Gemini, Copilot). The answers were evaluated by 5 different examiners in terms of readability, understandability, actionability, reliability, and transparency. Results: The DISCERN score evaluation indicates that ChatGPT and Gemini provided moderate quality information, while Copilot's quality was low. (Total DISCERN scores; 41, 42, 35, respectively). PEMAT-P Understandability scores were low (40%) and PEMAT-P Actionability scores were moderate only for Gemini (60%) and low for the others (40%). Their readability according to the Coleman-Liau index was above the college level (16.9, 17.2, 16, respectively). Conclusions: In the era of artificial intelligence, patients will inevitably use AICs due to their easy and fast accessibility. However, patients need to recognize that AICs do not provide stage-specific treatment options, but only moderate-quality, low-reliability information about the disease, as well as information that is very difficult to read.