Can artificial intelligence chatbots provide reliable patient education for penile curvature treatment? ¿Pueden los chatbots de inteligencia artificial proporcionar una educación confiable al paciente para el tratamiento de la curvatura del pene?
Revista Internacional de Andrologia, cilt.23, sa.3, ss.45-50, 2025 (SCI-Expanded, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 23 Sayı: 3
- Basım Tarihi: 2025
- Doi Numarası: 10.22514/j.androl.2025.029
- Dergi Adı: Revista Internacional de Andrologia
- Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, EMBASE, MEDLINE, DIALNET
- Sayfa Sayıları: ss.45-50
- Anahtar Kelimeler: Artificial intelligence, Chatbot, Quality assessment, Treatment, Penile curvature
- Sağlık Bilimleri Üniversitesi Adresli: Evet
Özet
Background: This study evaluated the reliability and quality of information provided by four artificial intelligence (AI) chatbots regarding penile curvature treatment. As patients increasingly seek medical information online, particularly for sensitive urological conditions such as penile curvature, AI chatbots have demonstrated potential for addressing these inquiries. However, the accuracy, comprehensiveness, and readability of their responses remain uncertain. The primary objective of this study was to evaluate the reliability and quality of information provided by AI chatbots on penile curvature treatments. Methods: The question “How is penile curvature treated?” was asked to four different AI chatbots: ChatGPT, Perplexity, Gemini and Copilot. Responses were independently evaluated by five urologists based on readability, understandability, actionability, reliability and transparency. The DISCERN score, PEMAT-P (Patient Education Materials Assessment Tool for Print Materials) test, WRR (Web Resource Rating) scale, Coleman-Liau index and Likert scale were used for assessment. Results: The DISCERN score evaluation showed that Gemini provided poor-quality information, ChatGPT and Copilot offered moderate-quality information, and Perplexity provided good-quality information (Total DISCERN scores: 31, 41, 42 and 51, respectively). PEMAT-P Understandability scores were 45% for Gemini, 55% for Copilot, 64% for ChatGPT and 73% for Perplexity. PEMAT-P Actionability scores were 40% for ChatGPT, Gemini and Copilot, and 60% for Perplexity. According to the Coleman-Liau index, readability levels were required at least at the university-level education. Conclusions: AI chatbots can be useful tools for obtaining information on penile curvature. Given their growing utilization, educating patients on effective interactions with AI chatbots to enhance response accuracy is crucial. With continuous updates and professional oversight, these tools are expected to evolve to become more effective in the future.