arXiv cs.AI· Doojin Baek, Junyeob Baek, Mingyu Jo, Hosung Lee, Taegu Kang, Gyubin Lee, Sungjin Ahn·· 4 小时前AI 评分27
BabyTheorist：一个仅凭观察学习世界理论的基准
BabyTheorist: A Benchmark for Learning to Theorize the World from Observation Alone
AI 导读
研究者提出 BabyTheorist 基准，用于评测"观察性理论学习"——从纯观察中习得可复用理论并应用于新情境的能力。该基准由隐藏的组合程序生成连续的前后视觉观察流，训练时不提供程序标签、任务身份或支持集，并控制程序语言、复杂度课程与带跳级的连续训练-测试协议。七个代表性基线均远低于上限，且随课程推进差距扩大。
正文 · 原文
Abstract:How would we know whether a machine truly understands the world? We argue that one key capability is \textit{observational theory learning}: acquiring reusable theories from pure observations and applying them to new situations. Current visual reasoning benchmarks focus primarily on the latter, presenting each task as a few-shot puzzle grouped by a common rule. We introduce BabyTheorist, a benchmark for controlled training and evaluation of observational theory learning. BabyTheorist generates continual streams of before-after visual observations from hidden compositional programs; during training, learners see only the resulting transitions, with no program labels, task identities, or support sets. To support theory learning and evaluation, BabyTheorist controls the program language, a curriculum over program complexity, recurring frequent subprograms, and a continual train-test protocol with level skipping. Seven representative baselines plateau well below ceiling, with the gap widening as the curriculum advances---evidence that BabyTheorist isolates a capability current program-learning approaches do not yet address.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.08177 [cs.AI] |
| (or arXiv:2611.08177v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.08177 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Junyeob Baek [view email]
[v1]
Thu, 5 Nov 2026 15:33:32 UTC (7,293 KB)
来源：arXiv cs.AI · arxiv.org