跳到正文
arXiv cs.AI· Rukmangadh Sai Myana, Sumit Kumar Jha, Yanzhao Wu·· 1 小时前AI 评分38

ERIG:熵正则化 Integrated Gradients 实现稳定特征归因

Entropy-Regularized Integrated Gradients for Stable Feature Attribution

AI 导读

研究者提出熵正则化归因方法 ERIG,通过带温度参数 τ 的最大熵 softmax 加权抑制积分路径上的梯度不规则性,并给出扰动下归因变化的 Lipschitz 界分析。

正文 · 原文

View PDF HTML (experimental)

Abstract:Path-based attribution methods like Integrated Gradients (IG) are widely used to interpret neural networks, yet imperceptible input perturbations can drastically alter their attribution maps while leaving model predictions unchanged. We introduce Entropy-Regularized Integrated Gradients (ERIG), a path-based attribution method that intrinsically attenuates gradient irregularities along the integration path using maximum-entropy softmax weighting with temperature parameter $\tau$. We quantify the effect of the entropy-regularized weighting on attribution stability by using the Lipschitz properties of the model and its gradients. We decompose the attribution change under an input perturbation into a model-response term, whose bound is $\tau$-independent, and a weight-variation term, whose bound decreases at rate $\mathcal{O}(1/(2\tau))$. Their ratio $R(\tau)$ characterizes the trade-off between gradient information and attribution stability. We further add a new dimension to attribution evaluation by adapting classical noise estimators into two metrics, LINV-C and LINV-P, that quantify attribution noise. Across eleven CNN and Transformer backbones on ImageNet and Oxford-IIIT Pet datasets, our experiments show that, relative to the next-best method, ERIG remains comparable on ranking-based fidelity metrics while improving localization by approximately 24% and attribution stability by approximately 47-fold on average, reaching up to four orders of magnitude improvement over IG, all at negligible additional computational cost.
Comments: 36 pages, 19 figures, 27 tables, including the appendix
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2611.23600 [cs.LG]
  (or arXiv:2611.23600v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2611.23600

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Rukmangadh Sai Myana [view email]
[v1] Tue, 17 Nov 2026 22:53:17 UTC (11,540 KB)

来源:arXiv cs.AI · arxiv.org