PIVOT:通过轨迹优化弥合 LLM 智能体的规划与执行鸿沟
PIVOT: Bridging Planning and Execution in LLM Agents via Trajectory Refinement
AI 导读
PIVOT(Plan-Inspect-eVOlve Trajectories)提出自监督框架,将轨迹作为可优化对象,通过 PLAN、INSPECT、EVOLVE、VERIFY 四阶段迭代改进 LLM 智能体的规划-执行错配。
正文 · 原文
Abstract:Large language model (LLM)-based agents frequently generate seemingly coherent plans that fail upon execution due to infeasible actions, constraint violations, and compounding errors over extended horizons. PIVOT (Plan-Inspect-eVOlve Trajectories) addresses this plan-execution misalignment through a self-supervised framework that treats trajectories as optimizable objects iteratively refined via environment interaction. The framework comprises four stages: PLAN generates candidate trajectories; INSPECT executes them and computes structured losses with textual gradients encoding plan-execution discrepancies; EVOLVE applies these signals to produce improved trajectories; and VERIFY performs a final global check against task constraints. A monotonic acceptance process ensures a non-decreasing solution quality. Empirical evaluations on DeepPlanning and GAIA demonstrate state-of-the-art performance: with human-in-the-loop (HITL) feedback, PIVOT establishes a strong upper bound up to 94% relative improvement in constraint satisfaction, while its fully autonomous variant retains substantial gains, showing that the core trajectory-refinement mechanism remains effective without external supervision. At the same time, PIVOT remains computationally efficient, requiring up to 3x to 5x fewer tokens than competing refinement methods. These findings establish that (self- or human-supervised) feedback-based trajectory optimization is a principled methodology for mitigating plan-execution gaps in autonomous agent systems.
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA) |
| Cite as: | arXiv:2605.11225 [cs.AI] |
| (or arXiv:2605.11225v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2605.11225 arXiv-issued DOI via DataCite |
Submission history
From: Dimitrios Dimitriadis [view email]
[v1]
Mon, 11 May 2026 20:43:20 UTC (4,250 KB)
[v2]
Tue, 27 Oct 2026 04:50:15 UTC (4,180 KB)
来源:arXiv cs.AI · arxiv.org