[Submitted on 17 Jun 2026 (v1), last revised 23 Oct 2026 (this version, v2)]
Abstract:A theory can accommodate a counterexample by adding an exception. The harder problem is deciding how far the exception should extend and which predictions should survive. We present DeFAb, a dataset and symbolic verification framework built from curated biological knowledge in the Gene Ontology. Models fill gaps in a theory or propose exceptions to its rules. A verifier checks the consequences of each edit, allowing different solutions to receive credit. Simple symbolic repairs solve all 336 tasks in the released evaluation panel. This result exposes a limitation of the revision test. An exception tied to one entity can succeed without identifying a pattern that applies to other cases. We develop a contextual task that requires an exception to reach the relevant cases and preserve predictions elsewhere. Two planned studies compare training with verified and rejected examples, and revision with and without feedback about consequences. DeFAb makes the scope of a proposed explanation testable, providing a controlled step toward studying theory revision in scientific reasoning.
Submission history
From: Patrick Cooper [view email]
[v1] Wed, 17 Jun 2026 00:13:40 UTC (272 KB)
[v2] Fri, 23 Oct 2026 02:03:13 UTC (55 KB)
