InfiniteWorld 基准:将视觉证据与惯性物理先验分离
InfiniteWorld: Separating Visual Evidence from Familiar Physics
AI 导读
研究者推出 InfiniteWorld 基准,用物理参数被系统性改动的模拟器视频配对物理推理问题,检验模型是否依据视觉证据作答。基准含律法识别、参数估计、时序推理、反事实比较与律法归纳五项任务,并为每题设置五种匹配输入条件。
正文 · 原文
Abstract:Physical reasoning requires adapting familiar expectations to the dynamics of the observed world. Existing benchmarks establish broad physical capabilities, yet an overall score leaves unclear whether answers follow visual evidence when familiar rules no longer apply. We introduce InfiniteWorld, a benchmark that pairs physical-reasoning questions with simulator videos whose physical parameters are systematically altered. Its generation pipeline connects simulation, scene screening, paired video translation, question construction, and input checks. Five tasks assess law identification, parameter estimation, temporal reasoning, analytic counterfactual comparison, and law induction. The evaluation defines five matched input settings for each question, comprising text-only evaluation and ordered or shuffled observations from simulator and translated videos. We evaluate a diverse set of video-language models under these matched settings. The results expose a persistent preference for familiar physical rules. Frames improve performance for most models, but gains differ across tasks. Strong accuracy on Earth-normal questions coexists with poor recognition of altered dynamics, and Earth-normal answers remain common when the observed physics changes. Task scores and semantic agreement further distinguish matching physical factors from matching their amount, and correct answers from repeated errors. InfiniteWorld makes these behaviors measurable through paired changes in the evidence supplied for the same question, separating visual evidence from familiar physics.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.33777 [cs.AI] |
| (or arXiv:2610.33777v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.33777 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yuxuan Cheng [view email]
[v1]
Sat, 24 Oct 2026 16:26:19 UTC (3,914 KB)
来源:arXiv cs.AI · arxiv.org