时间序列基础模型的动态多步解码策略研究
Dynamic Multi-Step Decoding for Time-Series Foundation Models
AI 导读
一项研究提出为冻结预训练的时间序列基础模型动态选择解码策略:由轻量级选择器基于骨干网络隐藏状态对候选 rollout 调度排序,用动态规划将候选评估降到二次复杂度,部署时由五个独立训练的选择器投票决定,不一致时回退到 one-shot 预测,全程无需微调骨干。
正文 · 原文
Abstract:Time-series forecasting models typically use a fixed decoding strategy at inference time: either one-shot prediction of the full horizon or autoregressive rollout over atomic chunks. While one-shot decoding reduces error accumulation, it can discard useful sequential structure; conversely, autoregressive decoding preserves temporal dependencies but may compound errors. We argue that the optimal decoding strategy is not fixed across inputs, but should be selected adaptively for each forecasting instance. We propose a dynamic strategy selector that treats the forecast rollout schedule as an inference-time decision problem for frozen pretrained time-series foundation models. The selector is a learned network that ranks candidate rollout schedules using hidden states of the backbone, and is trained on historical windows of the evaluated tasks for each backbone. To make the candidate set tractable over the exponentially large space of horizon partitions, we use dynamic programming that reduces candidate evaluation to quadratic complexity while preserving much of the oracle gain. At deployment, five independently trained selectors vote on each decision, and the policy follows their consensus, falling back to the backbone's one-shot forecast where they disagree. The construction requires only the backbone's hidden states and lightweight selectors, with no fine-tuning of the forecasting backbone. On fev-bench with a frozen Chronos-2 backbone, agreement-gated selection improves point-forecast skill (MASE) over one-shot decoding with statistical significance, mostly on longer horizons. It recovers about 6-8% of the gain that the same dynamic program attains with ground-truth selection. With a frozen Moirai-1.1-R-small backbone, the improvement is also significant on the full benchmark, and for both backbones we claim gains in point accuracy only.
| Comments: | 23 pages including appendix, 2 figures, 20 tables |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.34409 [cs.LG] |
| (or arXiv:2610.34409v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.34409 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Birmjune Kim [view email]
[v1]
Sun, 25 Oct 2026 16:10:01 UTC (167 KB)
来源:arXiv cs.AI · arxiv.org