跳到正文
arXiv cs.AI· Musa Cim, Burak Topcu, Mahmut Taylan Kandemir·· 1 小时前AI 评分57

论文提出终止滞后再量化编码智能体早解出晚停止现象

Termination Lag: Coding Agents Solve Early but Stop Late

AI 导读

arXiv 论文 2611.14960 提出「终止滞后」概念,指编码智能体首次生成正确补丁到运行结束之间的步数,覆盖五个模型、两个智能体框架和三个 SWE-bench 数据集。

正文 · 原文

View PDF HTML (experimental)

Abstract:Coding agents can solve a task well before they stop working on it. We characterize \emph{termination lag}--the number of steps between an agent's first correct patch and the end of its run--across five models, two agent frameworks, and three SWE-bench datasets by recording and testing every distinct repository patch generated during execution. Our analysis reveals that 38--82% of successful runs achieve a correct solution on their initial source-code edit. However, agents continue to expend substantial effort after correct patches, with post-solution steps accounting for a median of 35--37% for Qwen3-Coder and 54--60% for Laguna-XS.2 in successful runs on SWE-bench Verified and Multilingual. Agents spend most of these additional steps verifying their work and exploring the repository. In a small fraction of cases (1--8%), this continued activity leads agents to undo their earlier correct patch, leaving the final solution incorrect.
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as: arXiv:2611.14960 [cs.AI]
  (or arXiv:2611.14960v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.14960

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Burak Topcu [view email]
[v1] Wed, 11 Nov 2026 03:11:00 UTC (702 KB)

来源:arXiv cs.AI · arxiv.org