跳到正文
arXiv cs.AI· Xiangyu Wen, Qiang Xu·· 1 小时前AI 评分43

SideTaskBench:测量编码智能体未经授权的附带任务交付

SideTaskBench: Measuring Unauthorized Side-Task Delivery in Coding Agents

AI 导读

SideTaskBench 基准用于测量编码智能体在授权修复仓库时,是否会被第三方技术参考资料诱导完成并交付用户未请求的附带任务。基准包含 25 个 Python 修复任务和 190 个附带任务单元,通过四级相似度指数定义 300 对可执行修复-附带任务对;v10 相似度运行使用 DeepSeek-V4-Flash 完成全部 300 对、每对 8 次(共 2,400 次)。

正文 · 原文

View PDF HTML (experimental)

Abstract:Can a coding agent fix a user's repository while also completing and delivering work the user never requested? In this paper, we introduce SideTaskBench to measure this failure where third-party technical references induce agents to produce independent side-task artifacts during an authorized repair. Repair success alone misses this behavior. Our key measurement contribution is to pair each repair with a self-contained side task and verify side tasks' delivery success rate along with the repair success rate. The benchmark contains 25 Python repairs and 190 side-task units. Its four-level similarity index defines 300 executable repair--side-task pairs.
The experiments show roughly 40% valid delivery under wrapped requests for two models, alongside repair success close to their clean baselines. The completed v10 similarity run uses DeepSeek-V4-Flash on all 300 pairs, with eight repetitions per pair (2,400 runs). Conditional delivery ranges from 20.48% for L0 unrelated tasks to 57.44% for L3 mechanism-overlapping tasks, while the L1-L0 difference is 5.37 percentage points and remains sensitive to task composition. The central insight is that technical relevance may blur the authorization boundary for an agent, such that an agent can solve the requested problem and still deliver unauthorized work. SideTaskBench emphasizes this potential weakness of existing agents and provides a testbed for defenses that preserve repair capability while preventing unauthorized delivery. The code is available at: this https URL.
Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.14548 [cs.CR]
  (or arXiv:2611.14548v1 [cs.CR] for this version)
  https://doi.org/10.48550/arXiv.2611.14548

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Xiangyu Wen [view email]
[v1] Thu, 29 Oct 2026 03:46:04 UTC (179 KB)

来源:arXiv cs.AI · arxiv.org