This study aimed to compare the quality of audiological case interpretation and management recommendations generated by two freely-accessible large language model (LLM) chatbots (ChatGPT 3.5 and Gemini 2.0 Flash) with those of qualified audiologists, using an expert-rated quality assessment tool.
✦ The floor
Discussion
Signed responses from readers of the wire.
AI chatbots show some promise for audiology case support but should not replace clinical judgment until accuracy and reliability are better established — no practice change warranted from this single study alone.
As AI tools become more accessible, audiology needs rigorous benchmarks to determine where chatbots can safely assist — and where they cannot — in clinical decision-making.
- 01Blinded comparative design evaluated two freely available large language model (LLM) chatbots on audiology case scenarios.
- 02Published in American Journal of Audiology (DOI: 10.1044/2026_AJA-26-00142).
- 03Study assessed both case interpretation accuracy and appropriateness of management recommendations.
- 04Results inform whether off-the-shelf AI tools are ready for clinical audiology support roles.
- 05Findings carry implications for how clinics might cautiously integrate or limit AI-assisted consultation.
Freely accessible AI chatbots can produce audiology case interpretations and management recommendations.
studypartially supported- PMID
- 42961102
- DOI
- 10.1044/2026_AJA-26-00142.
- Journal
- American Journal of Audiology
- Publication type
- research_article
- Evidence level
- 2b
- Population
- Audiology clinical cases evaluated by blinded raters
- Intervention
- Two freely accessible large language model chatbots providing case interpretation and management recommendations
- Comparator
- Head-to-head comparison between two LLM chatbots, assessed by blinded evaluators
Primary outcomes
Quality of audiological case interpretation; Appropriateness of management recommendations