Shortcut Mitigation via Spurious-Positive Samples

shortcut-mitigation-via-spurious-positive-samples

Shortcut Mitigation via Spurious-Positive Samples

[Submitted on 13 May 2026 (v1), last revised 13 Nov 2026 (this version, v2)]

View PDF HTML (experimental)

Abstract:Shortcut mitigation strategies commonly rely on training data annotations, group-balanced held-out data or the presence of all groups, i.e., all combinations of (spurious) attributes and classes, in the training data. However, these requirements are rarely met in practice. We instead propose a method for targeted model analysis to identify a small set of instances in which the model relies on spurious attributes. Using that set and following “this feature should not be used for prediction” reasoning, we identify highly relevant neurons in an intermediate layer and regularize their impact. This ensures that models learn to depend on informative features rather than being right for the wrong reasons, thereby improving robustness without requiring additional balanced held-out data or annotations.

Submission history

From: Phuong Quynh Le [view email]
[v1] Wed, 13 May 2026 11:00:12 UTC (24,042 KB)
[v2] Fri, 13 Nov 2026 18:51:09 UTC (24,705 KB)