arXiv cs.AI· Yichen Feng, Zhangchen Xu, Fengqing Jiang, Yuetai Li, Bhaskar Ramasubramanian, Luyao Niu, Bill Yuchen Lin, Radha Poovendran·· 4 小时前AI 评分42
VisualSphinx：用于强化学习的大规模合成视觉逻辑谜题数据集
VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL
AI 导读
VisualSphinx 是首个大规模合成视觉逻辑推理训练数据集，旨在弥补 VLM 推理训练缺乏大规模结构化数据的问题。其规则到图像合成流水线从种子问题中提取并扩展谜题规则，生成可执行的渲染程序来组装图像。用标准 GRPO 与二元正确性奖励验证显示，VLM 在该数据集上训练后逻辑推理性能提升，且推理能力可迁移至代数、算术与几何推理任务。
正文 · 原文
Abstract:Vision language models (VLMs) are expected to perform effective multimodal reasoning and make logically coherent decisions, which is critical to tasks such as diagram understanding and spatial problem solving. However, current VLM reasoning lacks large-scale and well-structured training datasets. To bridge this gap, we propose VisualSphinx, a first-of-its-kind large-scale synthetic visual logical reasoning training dataset. To tackle the challenge of image synthesis with grounded answers, we propose a rule-to-image synthesis pipeline that extracts and expands puzzle rules from seed questions and generates executable rendering programs for puzzle assembly. Using standard GRPO with binary correctness rewards as a validation recipe, experiments show that VLMs trained on VisualSphinx benefit from the logical coherence and readability of our dataset and exhibit improved performance on logical reasoning tasks. The enhanced reasoning capabilities developed from VisualSphinx also benefit other reasoning tasks such as algebraic reasoning, arithmetic reasoning and geometry reasoning.
| Comments: | DMLR; Project page at this https URL |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2505.23977 [cs.CV] |
| (or arXiv:2505.23977v2 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2505.23977 arXiv-issued DOI via DataCite |
Submission history
From: Fengqing Jiang [view email]
[v1]
Thu, 29 May 2025 20:08:36 UTC (13,296 KB)
[v2]
Fri, 30 Oct 2026 17:01:52 UTC (5,296 KB)
来源：arXiv cs.AI · arxiv.org