自动驾驶中 Attention 并非相关性:注意力对驾驶决策因果性的挑战
Attention Is Not Relevance: Challenging the Causality of Attention in Autonomous Driving
AI 导读
一项研究检验了自动驾驶中用 Attention 估计周围物体相关性的准确性。研究基于 PlanT 2.0 这一 Transformer 架构的目标级规划模型,在超过 80,000 个合成驾驶场景中,将多种基于 Attention 的相关性估计方法与反事实分析得到的因果参考对比。
正文 · 原文
Abstract:Attention has become one of the most widely adopted solutions for estimating the relevance of surrounding objects and interpreting an autonomous vehicle's driving decisions. However, its ability to capture the causal impact of individual input elements on an AI model's output has long been discussed in the literature, particularly in the Natural Language Processing (NLP) domain. This work brings this discussion into the autonomous driving domain by analyzing the accuracy of attention in estimating the impact of an input object on an autonomous vehicle's driving, i.e., its relevance. To this end, we compare different attention-based relevance estimation methods against a causal reference of object relevance obtained through counterfactual analysis. We perform our analysis on more than 80,000 synthetic driving scenes using an autonomous vehicle based on PlanT 2.0, a state-of-the-art Transformer-based model for object-level planning. Results show that attention provides a correlational rather than causal indication of object relevance. Attention-based relevance estimation methods do not consistently identify all relevant objects and tend to incorrectly classify as relevant objects with little or no impact on the vehicle's driving. In particular, results show that attention can effectively identify relevant objects in simple single-lane, straight-road scenarios, but its accuracy degrades in more complex settings, such as multi-lane roads and intersections. These findings highlight the limitations of attention as a proxy for object relevance, calling for novel methods able to accurately capture the causal impact of individual objects on the vehicle's driving and distinguish it from correlational associations.
| Subjects: | Artificial Intelligence (cs.AI); Robotics (cs.RO) |
| Cite as: | arXiv:2611.24051 [cs.AI] |
| (or arXiv:2611.24051v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.24051 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Luca Lusvarghi [view email]
[v1]
Wed, 18 Nov 2026 08:42:22 UTC (738 KB)
来源:arXiv cs.AI · arxiv.org