跳到正文
arXiv cs.AI· Junyeong Ahn, Geonwoo Kim, Kinam Kim, Gihwi Kim, Hoonjin Jung, Hyojin Jang, Jaegul Choo·· 4 小时前AI 评分36

OmniShowcase 提出全向主体一致性视频生成方法,从多视角图像实现 360 度环绕

OmniShowcase: Omnidirectional Subject-Consistent Video Generation from Multi-View Images

AI 导读

OmniShowcase 是一种从多视角参考图像生成特定主体全向一致视频的方法,包含全自动数据合成管线和基于表面法线贴图的几何条件注入两部分。团队构建了覆盖 12 种相机运动、88 种轨迹配置的 Showcase-4K 训练语料,以及带源网格与相机参数的 ShowcaseBench 评测集。实验显示其主体身份与 3D 一致性达到 SOTA,同时保持有竞争力的视频质量与运动表现。

正文 · 原文

View PDF HTML (experimental)

Abstract:Generating videos of a specific subject from a few reference images remains challenging when the camera reveals surfaces that are not visible in the input. Early subject-to-video (S2V) methods condition on a single reference image and must therefore infer the subject's unseen appearance and geometry as the viewpoint changes. To address this limitation, recent methods extend S2V to multiple reference views, providing more information about the subject from different viewpoints. However, they do not explicitly specify the 3D structure that connects these observations. In addition, existing training data do not guarantee that viewpoint changes preserve the same underlying 3D subject. We present OmniShowcase, built on two components: (i) a fully automated data synthesis pipeline that produces training videos along diverse camera trajectories, with viewpoint variation driven by underlying subject geometry, even spanning full 360-degree orbits; and (ii) a geometry-conditioning method that provides the video model with a turntable of surface-normal maps reconstructed from the reference views without requiring temporal alignment with the generated frames. We construct Showcase-4K, a corpus of 3D-asset-based videos covering twelve camera motions across 88 trajectory configurations with reconstruction-derived surface-normal conditioning, and ShowcaseBench, a held-out evaluation set with the source meshes and camera parameters used to render each video. Experiments show state-of-the-art subject identity and 3D consistency while maintaining competitive video quality and motion. Project page: this http URL
Comments: 25 pages
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.35684 [cs.CV]
  (or arXiv:2610.35684v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2610.35684

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Junyeong Ahn [view email]
[v1] Mon, 26 Oct 2026 16:19:59 UTC (27,378 KB)

来源:arXiv cs.AI · arxiv.org