将世界模型用作对手:多智能体自博弈微调实现鲁棒运动规划(AWM)
World Models as Adversaries: Multi-Agent Self-Play Fine-Tuning for Robust Motion Planning
AI 导读
研究者提出对抗性世界建模(AWM),把自动驾驶的对抗鲁棒规划学习构建为受约束的 min-max 博弈,用多智能体自博弈微调替代外部场景生成器或模拟器密集回滚。该方法将规划器的预测世界模型转化为角色条件化对手,通过反事实信用分配学习稀疏、场景自适应的攻击联盟,同时 ego 规划器以尾险加权和参考锚定信任域优化鲁棒最优响应。
正文 · 原文
Abstract:Robust motion planning in dense traffic requires autonomous vehicles to interact in rare and safety-critical scenarios that are underrepresented in naturalistic driving data. Although adversarial training offers a feasible solution, existing methods often rely on external scenario generators, heuristic perturbations, or simulator-heavy rollouts, which makes them difficult to integrate with modern autoregressive planners. Here, we cast adversarially robust planner learning as a constrained min-max game and propose Adversarial World Modeling (AWM), a theoretically grounded multi-agent self-play fine-tuning framework. Since solving the exact game is intractable, AWM introduces a principled decoupled solver. In the inner minimization, the planner's predictive world model is converted into a role-conditioned adversary that learns sparse, scene-adaptive attack coalitions via counterfactual credit assignment. In the outer maximization, the ego planner optimizes a regret-aware robust best response against the frozen AWM, utilizing tail-risk weighting and reference-anchored trust regions to improve hard-case recovery while preserving nominal driving behavior. Experiments on the nuPlan and InterPlan benchmarks demonstrate that our method generates transferable adversarial interactions and yields a robust planner that achieves competitive closed-loop performance in both nominal and highly interactive long-tail scenarios. Theoretical analysis justifies the decoupled solver and the main optimization components.
| Comments: | Accepted at NeurIPS 2026 |
| Subjects: | Robotics (cs.RO); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2607.10630 [cs.RO] |
| (or arXiv:2607.10630v2 [cs.RO] for this version) | |
| https://doi.org/10.48550/arXiv.2607.10630 arXiv-issued DOI via DataCite |
Submission history
From: Tong Nie [view email]
[v1]
Sun, 12 Jul 2026 07:44:16 UTC (2,183 KB)
[v2]
Thu, 5 Nov 2026 04:34:59 UTC (3,257 KB)
来源:arXiv cs.AI · arxiv.org