Accuracy and safety of ChatGPT-4o responses in rhinoplasty postoperative counseling: a panel-based study
Acta Oto-Laryngologica, cilt.145, sa.9, ss.851-856, 2025 (SCI-Expanded, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 145 Sayı: 9
- Basım Tarihi: 2025
- Doi Numarası: 10.1080/00016489.2025.2541612
- Dergi Adı: Acta Oto-Laryngologica
- Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, CINAHL, EMBASE
- Sayfa Sayıları: ss.851-856
- Anahtar Kelimeler: Rhinoplasty, Artificial Intelligence, ChatGPT-4o, Postoperative Counseling, Large Language Models
- Sağlık Bilimleri Üniversitesi Adresli: Evet
Özet
Background: ChatGPT and other large language models have emerged as new tools for patient education, yet their clinical safety and reliability remain unclear. Objective: To assess the accuracy and safety of ChatGPT-4o’s responses to common postoperative questions following rhinoplasty. Methods: Ten consensus-based postoperative questions were identified via a modified Delphi process. ChatGPT-4o responses were generated and evaluated by three independent otolaryngologists using a 10-point Likert scale. Reviewers also assessed the presence of critical errors. Results: The average Likert score across responses was 8.87 (95% CI, 8.39 to 9.34), No critical errors were detected. Inter-rater reliability was high (ICC(2,k) = 0.876). Conclusions: ChatGPT-4o provided clinically accurate and safe answers to common rhinoplasty postoperative questions. Significance: These findings suggest that ChatGPT-4o may serve as a useful adjunct for postoperative patient counseling in structured settings, particularly when physician access is limited.