TL;DR
ChatGPT answered 10 common OSA questions. 1 response was excellent, 2 satisfactory-minimal clarification, 7 satisfactory-moderate clarification. Average DISCERN score: 41/80.
Background
Obstructive sleep apnea affects nearly 1 billion people worldwide. Hypoglossal nerve stimulation is an increasingly popular surgical alternative to CPAP. As patients turn to AI tools for health information, understanding reliability is critical.
Key Findings
Ten questions covering OSA diagnosis, HNS candidacy, surgical details, and recovery were posed to ChatGPT 3.5. Three blinded otolaryngologists graded responses using Mika et al. grading and DISCERN criteria.
- DISCERN: Average 41.0/80 (average quality)
- Grading: 1 excellent, 2 satisfactory-minimal, 7 satisfactory-moderate, 0 unsatisfactory
- Inter-rater reliability: IRR 0.533 (moderate agreement)
Reference
Assessing ChatGPT Responses to Commonly Asked Questions About Hypoglossal Nerve Stimulation. World Journal of Otorhinolaryngology - Head and Neck Surgery (2026). DOI: 10.1002/wjo2.70009 | PMID: 41948686