arXiv cs.AI· Emma Andrews, Konstantinos Kontras, Keane Ong, Maarten De Vos, Gianmarco Mengaldo·· 3 小时前AI 评分40
ATEMPO：一种按 lag 与时间摊销的扩散型转移熵估计模型
ATEMPO: Amortized Transfer Entropy Model Per-lag Over-Time
AI 导读
arXiv 论文提出 ATEMPO，一种基于扩散模型的转移熵估计器，通过对 lag 和时间摊 amortize 训练，单一 score 网络即可估计完整 TE surface，无需重复拟合。
正文 · 原文
Abstract:When one time series informs another, the delay at which that information arrives determines if models can utilize this relationship effectively. A source may be strongly predictive at one delay but uninformative at neighboring lags. Therefore, fixed input windows may obscure this structure by bundling informative and irrelevant history together. Transfer entropy (TE) can recover these delays by measuring how much a source's past tells us about a target beyond the target's own history. However, existing TE estimators require separate fits across source and conditioning depths, with further estimation on local windows to track delays over time. We introduce ATEMPO, a diffusion-based transfer entropy estimator amortized over lags and time. ATEMPO samples source and conditioning depths during training and conditions explicitly on temporal position, allowing a single score network to estimate the full TE surface without refitting. Differencing this surface recovers when information arrives. Across synthetic datasets with ground-truth TE, ATEMPO achieves the lowest mean relative error among baselines, and on datasets with known lags, ATEMPO achieves $0.98\pm0.04$ lag-detection accuracy. ATEMPO requires a single fit across source depths $K=6$ and target depths $L=3$, whereas existing estimators require 18 separate fits to evaluate the same $K \times L$ grid. On three systems with time-varying lag, ATEMPO is the only estimator to maintain perfect lag-detection accuracy across all evaluated window lengths. These recovered delays improve downstream forecasting: ATEMPO-selected inputs reduce MSE on WEATHER-5K by 7.25%, while 120 selected inputs outperform the benchmark's 240-feature default by 4.6%. Across three brain-computer interface tasks, using ATEMPO-selected lags achieves the highest or equal-best $R^2$, improving mean $R^2$ by 4.1% relative to the strongest competing baseline.
| Subjects: | Artificial Intelligence (cs.AI); Information Theory (cs.IT) |
| Cite as: | arXiv:2610.36536 [cs.AI] |
| (or arXiv:2610.36536v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.36536 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Emma Andrews [view email]
[v1]
Tue, 27 Oct 2026 02:49:07 UTC (605 KB)
来源：arXiv cs.AI · arxiv.org