EVA-RSI:视频评估器的递归自我改进框架,用于判断时序质量
EVA-RSI: Recursive Self-Improvement of Video Evaluators for Judging Temporal Quality
AI 导读
研究者提出 EVA-RSI,一个多智能体框架,让视频评估器通过递归自我改进提升对时序质量的判断。该框架用视频时序反转、丢帧等受控改动构建无需人工标注的代理考试,辅以少量人工标注视频锚定人类判断,各维度由 LLM 智能体提议改进,通过 Nash 讨价还价规则平衡多维度进展。
正文 · 原文
Abstract:Video evaluators play an important role in video generation, yet they miss motion defects, limiting the quality of generated videos. Recursive self-improvement (RSI) has made strong progress in mathematics and coding, where explicit verifiers provide reliable feedback on a single goal. Video evaluation poses two difficulties for RSI: it has no verifier, and it must judge many dimensions at once, such as physics, smoothness and dynamics, where a gain on one can cost another. We introduce EVA-RSI, a multi-agent framework for exploring RSI under these two constraints. We build a fixed proxy exam with construction-defined targets by applying controlled changes to videos, such as temporal reversal and frame dropping. These edits supply supervision without human annotation. A small set of human-labeled real videos anchors the exam to human judgment. Each dimension has an LLM agent that proposes improvements. A leader agent coordinates the proposals, and a Nash bargaining rule selects updates that balance progress across dimensions. Humans design the exam, review candidate changes and revise the curriculum between stages. Starting from Qwen3-VL-8B, EVA-RSI improves motion evaluation, with the largest gain on smoothness, and the gains carry over to defect types never seen during the run. On the dynamics subsets of public benchmarks, our evaluator achieves the highest observed scores among 21 tested models. As an RL reward, it increases generated motion and earns human preference. A data-selection pipeline incorporating it also increases motion.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.23890 [cs.AI] |
| (or arXiv:2611.23890v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.23890 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yu Yuan [view email]
[v1]
Wed, 18 Nov 2026 05:41:49 UTC (4,132 KB)
来源:arXiv cs.AI · arxiv.org