arXiv cs.AI· Sophia Zalewski, Mustafa Munir, Enting Liu, Anjul Patney, David Dynerman·· 2 小时前AI 评分39
PromptPack:免训练增强扩散编辑器,实现意图对齐的空间与语义控制
PromptPack: Training-Free Augmentation of Diffusion Editors for Intent-Aligned Spatial and Semantic Control
AI 导读
PromptPack 为扩散编辑器提供两组显式 Edit Guides:像素级的 Keep/Permit/Modify 编辑角色划分,以及将空间区域映射到文本提示词的区域提示分配,可基于 SAM 3 掩码自动生成。
正文 · 原文
Abstract:Many image-editing tasks require confining changes to intended spatial regions while exactly preserving user-designated source content. Instruction-driven editing pipelines often leave such user-intent underspecified, while inpainting editors condition generation on explicitly defined edit support but not on the spatial assignment of individual edit concepts. PromptPack addresses both limitations by equipping diffusion editors with two explicit 'Edit Guides': an edit-role partition that labels each pixel as 'Keep,' 'Permit,' or 'Modify' to specify where edits may occur, and a regional-prompt assignment that maps spatial regions to text prompts to specify which concepts apply where. These guides may be manually specified or, for source-object edits, automatically derived from a text-grounded SAM 3 mask. Without retraining, PromptPack injects independently embedded regional prompts into the editor's fixed-length text sequence and uses the Edit Guides to spatially mask attention, gate flow updates, and restore protected source pixels. We integrate PromptPack into FlowEdit FLUX, FlowEdit SD3, and FLUX Kontext and demonstrate improved requested-concept placement and protected-content preservation across all three integrations on PIE-Bench++. In a pairwise user study, PromptPack achieves an 87% preference rate over FlowEdit FLUX, establishing PromptPack as a practical, training-free interface for intent-aligned diffusion editing.
| Comments: | 32 pages, 21 figures, including supplementary material |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV) |
| Cite as: | arXiv:2611.21865 [cs.LG] |
| (or arXiv:2611.21865v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2611.21865 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Sophia Zalewski [view email]
[v1]
Mon, 16 Nov 2026 20:30:53 UTC (44,798 KB)
来源:arXiv cs.AI · arxiv.org