免训练合成图像溯源中的表示与参考选择分析
Representation and Reference Selection in Training-Free Synthetic Image Attribution
AI 导读
一项被 WIFS 2026 接收的研究对免训练参考式合成图像溯源中表示空间与参考构建的交互作用做了受控分析,比较了 CLIP 和 DINOv2 不同层的表示及三种参考选择策略。结果显示溯源精度通常在中间层表示达到峰值,语义约束的参考可减少查询-参考失配并提升精度,重合成参考在低参考量场景有用,而语义对齐参考在中等参考池下性价比更优。
正文 · 原文
Abstract:Synthetic image attribution aims at identifying the generator responsible for a given AI-generated image. Training-free reference-based attribution methods are easily scalable, since newly emerging generators can be incorporated by adding source-specific references rather than retraining a task-specific classifier. Their performance depends on two coupled factors: the representation space used for comparison and the way source-specific references are constructed. However, the interaction between these two factors remains largely unexplored. In this paper, we provide a controlled analysis of this interaction using references and off-the-shelf pretrained representations. We study representations extracted from different layers of CLIP and DINOv2, along with three reference selection strategies with varying semantic constraints: arbitrary, semantically aligned, and resynthesis-based references. Our results show that attribution accuracy generally peaks at intermediate representation levels, indicating that source-discriminative cues are more accessible before strong semantic abstraction dominates. We further show that intermediate representations are not completely semantically neutral, making reference selection critical: semantically constrained references reduce query-reference mismatch and improve attribution, especially under limited reference budgets. Resynthesis is useful in low-reference regimes, while semantically aligned references provide a better accuracy-cost trade-off when a moderate-sized reference pool is available. Our findings show that training-free reference-based attribution should be understood as the interaction between where images are compared, how the reference set is constructed, and how many references are available. Code and datasets are available at this https URL.
| Comments: | 6 pages, 5 figures, 4 tables. Accepted at the 2026 IEEE International Workshop on Information Forensics and Security (WIFS 2026) |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR) |
| Cite as: | arXiv:2607.12052 [cs.CV] |
| (or arXiv:2607.12052v2 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2607.12052 arXiv-issued DOI via DataCite |
Submission history
From: Meiling Li [view email]
[v1]
Mon, 13 Jul 2026 18:10:39 UTC (1,130 KB)
[v2]
Wed, 28 Oct 2026 07:28:27 UTC (1,145 KB)
来源:arXiv cs.AI · arxiv.org