跳到正文
arXiv cs.AI· Nikos Theodoridis, Reenu Mohandas, Sushil Sharma, Ciar\'an Hogan, Ganesh Sistu, Anthony Scanlan, Tim Brophy, Ciar\'an Eising·· 2 小时前AI 评分52

ReactBench-AD 基准揭示驾驶 VLA 与世界动作模型对突发危险反应微弱

ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?

AI 导读

Limerick 大学等研究团队(作者 Nikos Theodoridis 等)提出 ReactBench-AD 基准,基于 NAVSIM 和 PhysicalAI-Autonomous-Vehicles 真实场景合成横穿行人、站立行人或静止车辆,构成像素级反事实配对,测量驾驶模型对突现障碍的反应。

正文 · 原文

View PDF HTML (experimental)

Abstract:Vision-Language-Action models (VLAs) and World-Action Models (WAMs) have emerged in autonomous driving with the promise of strong generalization to long-tail scenarios. Although these models achieve state-of-the-art results on autonomous driving benchmarks, most existing benchmarks are dominated by nominal scenarios and therefore cannot test this promise. To test one such long-tail capability that is critical for safety, we introduce ReactBench-AD, a benchmark that measures how driving models react to objects that appear in the ego vehicle's path. Built on real NAVSIM and PhysicalAI-Autonomous-Vehicles scenes, ReactBench-AD composites a crossing pedestrian, a standing pedestrian, or a stationary car consistently across all camera views and history frames. Each edited scene thus forms an exact, pixel-level counterfactual pair with its original, which allows us to isolate the causal effect of the inserted object on the predicted trajectory. Evaluating four VLAs and two WAMs, we find that they react weakly, often barely at all. Finally, we test how easily one of the evaluated VLAs, ReCogDrive, can be taught to brake hard for imminent hazards: a short fine-tuning stage on edited scenes substantially improves its reactions, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving. These results call into question the out-of-the-box long-tail capabilities of these models, but suggest that they can be a strong foundation for acquiring them with little additional training, highlighting the value of real or synthetic data that demonstrates the long-tail behaviors nominal datasets rarely contain.
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
Cite as: arXiv:2611.20011 [cs.CV]
  (or arXiv:2611.20011v2 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2611.20011

arXiv-issued DOI via DataCite

Submission history

From: Nikos Theodoridis [view email]
[v1] Sun, 15 Nov 2026 13:42:52 UTC (15,793 KB)
[v2] Tue, 17 Nov 2026 19:28:26 UTC (15,796 KB)

来源:arXiv cs.AI · arxiv.org