arXiv cs.AI· Tong Nie, Yihong Tang, Junlin He, Yuewen Mei, Jie Sun, Lijun Sun, Wei Ma, Jian Sun·· 4 小时前AI 评分40
ADV-0:面向长尾鲁棒驾驶的偏好引导对抗策略优化框架
Preference-Guided Adversarial Policy Optimization for Long-Tail Robust Driving
AI 导读
一项 NeurIPS 2026 接收的研究提出 ADV-0,一个闭环 min-max 优化框架,将驾驶策略(防守方)与对抗智能体(攻击方)的交互建模为零和 Markov 博弈,把对抗者演化转化为迭代偏好学习。理论上 ADV-0 收敛到 Nash 均衡并最大化真实性能的认证下界。实验显示其能揭示多样化安全关键失效,显著提升学习策略与运动规划器对未见长尾风险的泛化能力。
正文 · 原文
Abstract:Deploying autonomous driving systems requires robustness against long-tail scenarios that are rare but safety-critical. While adversarial training offers a promising solution, existing methods typically decouple scenario generation from policy optimization and rely on heuristic surrogates. This leads to objective misalignment and fails to capture the shifting failure modes of evolving policies. This paper presents ADV-0, a closed-loop min-max optimization framework that treats the interaction between driving policy (defender) and adversarial agent (attacker) as a zero-sum Markov game. By aligning the attacker's utility directly with the defender's objective, we reveal the optimal adversary distribution. To make this tractable, we cast dynamic adversary evolution as iterative preference learning, efficiently approximating this optimum and offering an algorithm-agnostic solution to the game. Theoretically, ADV-0 converges to a Nash Equilibrium and maximizes a certified lower bound on real-world performance. Experiments indicate that it effectively exposes diverse safety-critical failures and greatly enhances the generalizability of both learned policies and motion planners against unseen long-tail risks.
| Comments: | Accepted at NeurIPS 2026 |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2603.15221 [cs.LG] |
| (or arXiv:2603.15221v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2603.15221 arXiv-issued DOI via DataCite |
Submission history
From: Tong Nie [view email]
[v1]
Mon, 16 Mar 2026 12:58:31 UTC (5,220 KB)
[v2]
Thu, 5 Nov 2026 04:35:34 UTC (5,216 KB)
来源:arXiv cs.AI · arxiv.org