arXiv cs.AI· Egor Pakhomov, Anurag Koul, Hongjun Liu, Bo Pang, Shafiq Joty, Erik Nijkamp·· 1 小时前AI 评分54
arXiv 论文:清理 Agent 历史在错误仍存于环境时反而有害
Cleaning an Agent's History Hurts When the World Still Holds the Error
AI 导读
一篇 arXiv 论文(arXiv:2611.14654)通过冻结任务中途的智能体并编辑历史或环境来研究历史清理的影响:在 AgentCE-Bench 上,保留错误旁加真实备注使接收模型恢复率从 51% 升到 66%,而把修正伪装成已完成动作则使其从 50% 降到 44%。
正文 · 原文
Abstract:Tool-using language-model agents accumulate histories of their own mistakes, and a system that compacts, repairs or hands off such a history decides what it says about those mistakes while their effects stay in the world. Prior work cleans the history at a fixed world, where showing a corrected step and saying it is done move together. We ask whether the same correct content helps or hurts depending on how the history states it and what the world holds. We freeze an agent mid-task with its exact world state, edit the history or the world, and let a receiver model continue. On AgentCE-Bench, after the agent commits a wrong value, we hold the world fixed and add the correct value by two natural edits: a truthful note beside the preserved error or the agent's own completed action. The note raises recovery, the share of remaining targets the receiver gets right, from 51% under a matched neutral note to 66%. The completed action lowers it below the unedited history, from 50% to 44%, so the value's presence alone does not predict the effect. On AppWorld, after a database write, we vary whether its receipt reports success or failure and whether its effect is present. A success receipt lowers whole-task success from 45% to 28% while the effect is absent and raises it from 38% to 49% once present. The two effects differ by 27 points pooled over two receivers, a difference positive in six of eight receivers at 97.5% and seven at 95%. A history edit's effect thus depends on the world it describes, and a history made to look clean while the world still holds the error can leave an agent worse off than no edit at all.
| Comments: | 23 pages, 6 figures; code and data in ancillary files |
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.14654 [cs.AI] |
| (or arXiv:2611.14654v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.14654 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Anurag Koul [view email]
[v1]
Tue, 10 Nov 2026 19:06:36 UTC (8,443 KB)
来源:arXiv cs.AI · arxiv.org