arXiv cs.AI· Khai Loong Aw, Klemen Kotar, Baihan Zhang, Yifan Liu, Lilian Chen, Atlas Kazemian, Rahul Venkatesh, Daniel Yamins·· 2 小时前AI 评分45
Ψ-0.6:统一视觉-语言世界模型中的自适应思维流
$\Psi$-0.6: Adaptive Streams of Thought in a Unified Vision-Language World Model
AI 导读
Ψ-0.6 是一个统一视觉-语言世界模型,在共享推理过程“思维流”中自适应组合感知、语言、几何与仿真,通过共享 token 接口生成并解读图像、文本及几何与运动表征。该模型在多视角空间推理上零样本超越领先开源权重模型,还支持反事实仿真以判断移动物体是否阻挡通路。基于任务反馈的强化学习联合优化中间表征的选择、生成与使用,提升视觉问答准确率并迁移至未见基准。
正文 · 原文
Abstract:Humans reason about the physical world by flexibly combining different forms of inference as a problem unfolds. Achieving this flexibility is a major open challenge in AI: capabilities often remain separated across specialized models, limiting how they can be composed and jointly adapted to a task. We introduce $\Psi$-0.6, a unified vision-language world model that adaptively composes perception, language, geometry, and simulation within a shared reasoning process we call streams of thought. These streams interleave images, text, and explicit representations of geometry and motion, all of which the model can generate and interpret through a shared token interface. $\Psi$-0.6 surpasses leading open-weight models zero-shot on multi-view spatial reasoning, with further gains from reasoning through geometric intermediates. It also supports counterfactual simulation: generating and interpreting imagined scenes to determine, for example, whether moving an object would obstruct a pathway. Reinforcement learning from task feedback jointly optimizes the selection, generation, and use of intermediate representations, improving visual question-answering accuracy with gains that transfer to unseen benchmarks. $\Psi$-0.6 offers a path toward adaptive physical reasoning -- not only predicting the physical world but also choosing the representations through which to reason.
| Subjects: | Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.32177 [cs.AI] |
| (or arXiv:2610.32177v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.32177 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Khai Loong Aw [view email]
[v1]
Fri, 23 Oct 2026 05:24:02 UTC (13,260 KB)
来源:arXiv cs.AI · arxiv.org