跳到正文
arXiv cs.AI· Woosang Lim (SAINT Machines, KAIST), Yeseul Chang (Chung-Ang University), Jaewoo Lee (Chung-Ang University)·· 4 小时前AI 评分52

SPILLWAY:分离目标准入与净化以防御工具型智能体的提示注入

SPILLWAY: Separating Target Admission from Sanitization to Defend Tool-Using Agents against Prompt Injection

AI 导读

KAIST 等机构提出 SPILLWAY,将目标准入与净化分离,为工具型智能体抵御提示注入提供无需逐任务计划的确定性防线:工具调用仅当目标值来自只读工具的类型化字段或固定委托规则时放行,确定性净化器在模型读取前移除指令样文本并保留证据。

正文 · 原文

View PDF HTML (experimental)

Abstract:Tool-using agents act on email, files, and payments, so an instruction hidden in a web page or a shared document can make an agent send data or money to an attacker. Many runtime defenses put a language model on the decision that lets an action through, so the decision depends on a model that may read the attacker's text and adds model calls to every step. Provenance defenses keep the model off the final check but need a model to plan or route each task first. Where an action goes can instead be read from the tools' typed returns: an email's sender or a payment's account arrives in a typed field, while injected instructions arrive as free text. SPILLWAY turns this observation into a deterministic floor with no per-task plan. The check admits a call when each target value that appears in tool output but not in the user's task was returned by a read-only tool in a typed field or is covered by a fixed delegation rule. A deterministic sanitizer removes instruction-like regions its fixed rules match before the model reads them and retains the removed spans as evidence, and a local judge may restore a refused call, never one whose target lies in the removed text. Across three backbones, and seven task suites on one of them, no standard templated injection redirects an action to an attacker's target under SPILLWAY, at the highest observed mean utility and composite scores (NRP, ERS) of the defenses we run under that attack. A forged chat template also produces a raw zero, and mean in-scope attack success under a released reinforcement-learning attacker is .007. SPILLWAY reaches this floor with no defense-triggered backbone re-run and almost no added model call. As personal AI agents act on users' email, files, and payments, SPILLWAY gives them an auditable refusal floor on where their actions go that keeps them useful and holds across backbones.
Comments: An earlier version was accepted at the Third Workshop on Agents in the Wild: Safety, Security, and Beyond (NeurIPS 2026). 16 pages. Project page: this https URL Code and per-cell results: this https URL
Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.07222 [cs.CR]
  (or arXiv:2611.07222v1 [cs.CR] for this version)
  https://doi.org/10.48550/arXiv.2611.07222

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Woosang Lim [view email]
[v1] Wed, 4 Nov 2026 23:18:10 UTC (267 KB)

来源:arXiv cs.AI · arxiv.org