Abstract ID: 26-105
Revolutionizing Patient Education: AI Versus Experts in Ocular Dyskinesia Responses
Author: Shirin Hamed Azzam Base Hospital / Institution: Tsafon Medical Center, Poriya
Presentation Type: ePoster Presentation
Purpose
Ocular dyskinesia, including dystonic blepharospasm and hemifacial spasm, significantly impact patient quality of life. This study evaluates the effectiveness of advanced AI models (ChatGPT-3.5, GPT-4o, Gemini, and Gemini Advanced) compared to expert ophthalmologists in providing accurate, reliable, and patient-focused answers to common ocular dyskinesia-related questions.
Methods
A panel of oculoplastic surgeons developed 13 clinically relevant questions addressing symptoms, treatments, and post-treatment care for ocular dyskinesia. Anonymized responses from Four AI models (ChatGPT-3.5, GPT-4o, Gemini, and Gemini Advanced) and experts were evaluated by a panel of seven international oculoplastic surgeons for correctness and reliability using a 7-point Likert scale. Statistical analyses were performed to identify differences among groups.
Results
ChatGPT-3.5 emerged as the top-performing model, achieving the highest correctness (mean score: 5.80) and reliability score (5.68), surpassing both GPT-4o (5.58/5.38) and the expert panel (5.56/5.31). GPT-4o closely mirrored expert performance, while Gemini and Gemini Advanced consistently lagged, reflecting lower correctness (4.67 and 5.03, respectively) and reliability scores. Statistical analysis confirmed significant differences across groups (p<0.001).
Conclusion
ChatGPT-3.5 demonstrates exceptional potential in transforming patient education regarding ocular dyskinesia, delivering highly accurate and patient-accessible responses. While ChatGPT-4o and experts offer strong, clinically sound insights, the Gemini models require refinement to meet higher benchmarks. These findings underscore the potential role of AI in complementing human expertise, paving the way for innovative and collaborative approaches to patient care and education.
Additional Authors
| First name | Last name | Base Hospital / Institution |
|---|---|---|
| Morris | Hartestein | Shamir Medical Center |
| Cat | Burkat | University of Wisconsin, Madison, United States |
| Daniel | Ezra | Moorfields Eye Hospital |
| Allan | Wulc | 5Scheie Eye Institute, University of Pennsylvania, Philadelphia |
| Ofira | Zloto | Shamir Medical Center |
| John | Holds | Saint Louis University School of Medicine, St. Louis, MO USA |
| Daniel | Bahir | Tzafon Medical Center |