GRAFT:面向 Agent 设计的执行引导式遗传重组方法
GRAFT: Execution-Guided Genetic Recombination for Agent Design
AI 导读
GRAFT 是一种自动化 Agent 设计方法,在总体适应度做选择之外,利用父代专属的执行证据引导带变异的语义交叉,且不披露参考答案、无需额外任务执行。在六个推理与编程场景、使用开源权重优化与执行模型的评测中,GRAFT 平均测试准确率达 82.0%,超出最强基线 9.8 个百分点;消融实验证明执行证据在固定初始化、搜索规则与评估预算时仍提升准确率。
正文 · 原文
Abstract:Automated agent design searches for executable architectures that improve LLM-based agent performance, with evolutionary methods using language-model crossover to recombine promising mechanisms for task decomposition, model coordination, and verification. This search, however, is typically guided by aggregate fitness alone, which hides the instance-level successes and failures behind each score. We introduce Execution Guided Genetic Recombination for Agent Design (GRAFT), which uses aggregate fitness for selection and survival and parent-specific execution evidence to guide semantic crossover with integrated mutation. Its feedback harness reuses bounded samples of successful and failed runs from fitness evaluation, withholding reference answers and requiring no additional task executions. We evaluate GRAFT across six reasoning and programming settings using open-weight optimizer and executor models. It achieves a mean test accuracy of 82.0%, exceeding the strongest baseline by 9.8% points. Controlled ablations show that adding execution evidence improves test accuracy with initialization, search rules, repair policies, and evaluation budgets held fixed. Our results support the value of parent-specific execution evidence for evolutionary agent design.
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE) |
| Cite as: | arXiv:2611.23509 [cs.AI] |
| (or arXiv:2611.23509v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.23509 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Sevda Ebrahimi [view email]
[v1]
Tue, 17 Nov 2026 21:01:08 UTC (164 KB)
来源:arXiv cs.AI · arxiv.org