NER-D: A cross-domain benchmark for German NER

ner-d:-a-cross-domain-benchmark-for-german-ner

NER-D: A cross-domain benchmark for German NER

[Submitted on 13 Nov 2026]

View PDF HTML (experimental)

Abstract:We present NER-D, a cross-domain benchmark for German NER comprising 13 datasets spanning 9 domains, including General/Politics, Wikipedia, Legal, Medical, Historical, Financial, Agriculture and Archaeology. We examine the performance of both proprietary LLMs and state-of-the-art small open-source models using normal prompting and further examine the performance gains achievable via in-context learning and LoRA fine-tuning. Our results show that without any sort of optimization a proprietary model (GPT-5.4 mini) outperforms the smaller open-source models on 6 out of 13 datasets, but LoRA fine-tuning enables the smaller models to substantially outperform the proprietary baseline. We further analyze the influence of the domain and the tagset used in each task on the performance achieved in the different evaluation settings. Our benchmark will be available as a resource for the development of future German NER methods on both general and specialized domains.footnote{We make our code, data, and models publicly available upon acceptance of this paper.

Submission history

From: Marc Felix Brinner [view email]
[v1] Fri, 13 Nov 2026 14:54:21 UTC (48 KB)