The incorporation of artificial intelligence (AI), especially large language models like Generative Pretrained Transformer 4 (GPT-4), into medical practice is a burgeoning field of interest. This research evaluates the applicability of GPT-4 in otology by analyzing its responses to queries based on otologic clinical practice guidelines.
Audiologists and otologists should not rely on GPT-4 as a standalone clinical reference for otology decisions until its accuracy and completeness against validated guidelines is formally confirmed; this study's results should guide cautious, supplementary use only.
As AI tools become more common in clinical settings, understanding where they align with or diverge from established otology guidelines is critical for patient safety and professional decision-making.
- 01GPT-4 responses to otology clinical questions were benchmarked against established guidelines in Otology & Neurotology Open.
- 02Study evaluates both accuracy (correctness) and completeness (coverage) of AI-generated answers.
- 03Findings will directly inform whether AI chatbots are safe to use as quick-reference tools in ear/hearing clinics.
- 04Evidence level is relatively low (observational evaluation study); no patient outcomes were measured.
- 05Highlights growing need for AI validation frameworks specific to audiology and otology.
GPT-4 can provide responses to otology clinical questions, but their accuracy and completeness relative to established guidelines requires formal evaluation.
studyunclear- PMID
- 42465680
- DOI
- 10.1097/ONO.0000000000000059.
- Journal
- Otology & Neurotology Open
- Publication type
- research_article
- Evidence level
- 4
- Population
- AI-generated responses to otology clinical questions (no human patient participants)
- Intervention
- GPT-4 AI responses to otology clinical questions
- Comparator
- Established otology clinical guidelines
Primary outcomes
Accuracy of GPT-4 responses versus guideline recommendations; Completeness of GPT-4 responses versus guideline recommendations