Profiling Hallucinations in Frontier LLMs for Entity Linking to Medical Ontologies

profiling-hallucinations-in-frontier-llms-for-entity-linking-to-medical-ontologies

Profiling Hallucinations in Frontier LLMs for Entity Linking to Medical Ontologies

[Submitted on 25 Aug 2026]

View PDF HTML (experimental)

Abstract:The integration of Large Language Models (LLMs) into healthcare promises to revolutionize clinical documentation and interoperability, yet reliability remains a concern. This study presents a comprehensive analysis of hallucinations by frontier LLMs tasked with mapping clinical text to SNOMED CT. Through rigorous experimentation, we identify a critical reliability gap: LLMs hallucinate medical codes at a rate that currently renders them unsuitable for autonomous clinical coding applications. Paradoxically, constraining models to use ground-truth mention spans exacerbates, rather than mitigates, these hallucinations. We further contribute a taxonomy of hallucination types–including deprecated codes and cross-ontology errors–and demonstrate that general-purpose LLMs significantly underperform compared to specialized zero-shot entity linking approaches. These findings underscore the need for robust verification mechanisms before clinical deployment.

Submission history

From: Logan Born [view email]
[v1] Tue, 25 Aug 2026 17:18:19 UTC (529 KB)