Scientist World 论文：为 AI 科学家构建可执行的科研世界并发布首批 1,000 个环境
Scientist World: Grow a Research World for AI-Scientists
AI 导读
arXiv 论文 Scientist World（arXiv:2611.08478）将每篇研究论文转成可执行环境，供 AI-Scientist 在其中以原论文方法为基线进行评测。
推荐理由
论文把研究论文转成可执行环境供 AI 科学家评测与训练，74% 超越率与 +158% 小模型提升给出可查的数据支撑。
正文 · 原文
Abstract:AI-Scientists arrived, but a world for them to grow in did not. Human scientists take theirs for granted $-$ centuries of open problems and shared ideas, waiting in the scientific literature. To AI-Scientists, that world is readable but not runnable, so we build Scientist World for them: every research paper becomes an executable environment. Our autonomous pipeline extracts each paper's open-ended research question and reproduces its proposed method as the baseline; an AI-Scientist entering the environment is evaluated against what the human authors achieved. We release the first 1,000 verified environments. With the world as an evaluation, we found that frontier AI-Scientists can already surpass the human researchers 74% of the time. As a record of how AI does science, it contains 6,400 hours of research traces, with every idea, experiment, failure, and success. As a training ground, we are able to raise (+158%) a small model to match frontier models in research ideation. At last, AI-Scientists' own world has arrived, grown from and growing with science itself.
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.08478 [cs.AI] |
| (or arXiv:2611.08478v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.08478 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: TaiMing Lu [view email]
[v1]
Thu, 5 Nov 2026 18:58:17 UTC (12,169 KB)
来源：arXiv cs.AI · arxiv.org