跳到正文
arXiv cs.AI· Josh Rountree, Pulkit Verma, Oswin So, Chuchu Fan, Julie A. Shah·· 3 小时前AI 评分41

CCW-Net:让深度神经网络的概念解释具备因果性

Causal Concept Explanations for Deep Neural Models

AI 导读

研究者提出 CCW-Net(Causal Concept Wrapper Network),首次将经济学、医学等领域使用的干预性中介分析作为训练目标,使概念解释对模型输出既必要又充分,且各概念贡献相互独立。

正文 · 原文

View PDF HTML (experimental)

Abstract:Concept-based explanations in neural models are important for the development, certification, and adoption of autonomous systems. Yet, interpretability remains correlational. Without methods to guide and quantify causal relationships between explanations, a concept explanation can be provided without being necessary or sufficient for the observed output thereby appearing correct while misleading. We introduce Causal Concept Wrapper Network (CCW-Net), the first use of interventional mediation analysis from fields such as economics, medicine, and epidemiology as a training objective to align causal effects of concept-based explanations with a model's output. We further apply mediation analysis as an evaluation tool to quantify, per concept label combination, how much of any model's output is causally attributable to each concept explanation. As a training objective, CCW-Net shapes a model's concept representations such that they are both necessary and sufficient for the outputs they are credited with and independent of other concepts' contributions. Counterfactual concept representations anchor a set of causal alignment criteria: necessity, sufficiency, and independence. Necessity drives irrelevant concept effects toward zero, sufficiency ensures relevant concept representations fully reconstruct a model's output, and independence enforces the total effect decomposes linearly across concepts. We evaluate CCW-Net across aircraft control, driving, and image classification. CCW-Net provides a step toward concept-based explanations that are not merely interpretable, but quantifiably causal, supporting safer evaluation, certification, and deployment of transparent and trustworthy neural models.
Comments: Accepted at NeurIPS 2026. 28 pages, 1 figure, 9 tables. Code: this https URL
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.14407 [cs.LG]
  (or arXiv:2611.14407v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2611.14407

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Josh Rountree [view email]
[v1] Tue, 10 Nov 2026 17:50:15 UTC (155 KB)

来源:arXiv cs.AI · arxiv.org