DeFAb：基于可废止溯因的科学发现数据集
DeFAb: A Dataset for Grounded Scientific Discovery through Defeasible Abduction
AI 导读
研究者发布 DeFAb，一个基于 Gene Ontology 生物学知识构建的科学理论修正数据集与符号验证框架。模型需在理论中填补缺口或提出例外规则，验证器检查每次修改的后果；简单的符号修复即可解决已发布评测面板中的全部 336 个任务。该结果暴露了修正测试的局限，论文进一步设计了要求例外触及相关案例并保留其余预测的上下文任务。
正文 · 原文
Abstract:A theory can accommodate a counterexample by adding an exception. The harder problem is deciding how far the exception should extend and which predictions should survive. We present DeFAb, a dataset and symbolic verification framework built from curated biological knowledge in the Gene Ontology. Models fill gaps in a theory or propose exceptions to its rules. A verifier checks the consequences of each edit, allowing different solutions to receive credit. Simple symbolic repairs solve all 336 tasks in the released evaluation panel. This result exposes a limitation of the revision test. An exception tied to one entity can succeed without identifying a pattern that applies to other cases. We develop a contextual task that requires an exception to reach the relevant cases and preserve predictions elsewhere. Two planned studies compare training with verified and rejected examples, and revision with and without feedback about consequences. DeFAb makes the scope of a proposed explanation testable, providing a controlled step toward studying theory revision in scientific reasoning.
| Comments: | 12 pages, 3 figures |
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Logic in Computer Science (cs.LO) |
| MSC classes: | 68T27, 68T30, 68T05, 03B70 |
| ACM classes: | I.2.3; I.2.4; I.2.6; I.2.7 |
| Cite as: | arXiv:2606.18557 [cs.AI] |
| (or arXiv:2606.18557v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2606.18557 arXiv-issued DOI via DataCite |
Submission history
From: Patrick Cooper [view email]
[v1]
Wed, 17 Jun 2026 00:13:40 UTC (272 KB)
[v2]
Fri, 23 Oct 2026 02:03:13 UTC (55 KB)
来源：arXiv cs.AI · arxiv.org