This paper has been withdrawn by arXiv Admin
[Submitted on 26 Jul 2024 (v1), last revised 26 Oct 2026 (this version, v4)]
No PDF available, click to view other formats
Abstract:Language Models (LMs) have demonstrated exceptional performance across various Natural Language Processing (NLP) tasks. Despite these advancements, LMs can inherit and amplify societal biases related to sensitive attributes such as gender and race, limiting their adoption in real-world applications. Therefore, fairness has been extensively explored in LMs, leading to the proposal of various fairness notions. However, the lack of clear agreement on which fairness definition to apply in specific contexts and the complexity of understanding the distinctions between these definitions can create confusion and impede further progress. To this end, this paper proposes a systematic survey that clarifies the definitions of fairness as they apply to LMs. Specifically, we begin with a brief introduction to LMs and fairness in LMs, followed by a comprehensive, up-to-date overview of existing fairness notions in LMs and the introduction of a novel taxonomy that categorizes these concepts based on their transformer architecture: encoder-only, decoder-only, and encoder-decoder LMs. We further illustrate each definition through experiments, showcasing their practical implications and outcomes. Finally, we discuss current research challenges and open questions, aiming to foster innovative ideas and advance the field. The repository is publicly available online at this https URL.
Submission history
From: arXiv Admin [view email]
[v1] Fri, 26 Jul 2024 01:21:25 UTC (1,138 KB)
[v2] Tue, 5 Aug 2025 20:22:54 UTC (6,795 KB)
[v3] Thu, 15 Jan 2026 02:02:02 UTC (6,729 KB)
[v4] Mon, 26 Oct 2026 20:38:22 UTC (1 KB) (withdrawn)
