跳到正文
arXiv cs.AI· Kathik Iyer·· 2 小时前AI 评分26

审计零售预测中的世界模型解释:忠实性、准确性与价格响应

Auditing World-Model Explanations in Retail Forecasting: Faithfulness, Accuracy and Price Response

AI 导读

一项研究为声明促销提升(plan lift)的预测模型定义了八项审计检查,并在一个 world model 与 LightGBM 上运行,其中六项设有事先固定的通过规则。

正文 · 原文

View PDF HTML (experimental)

Abstract:Forecasting models that read the price and promotion plan explain each forecast as a baseline, what would sell with nothing planned, plus the lift the plan adds, and merchants order stock and plan promotions on that lift. We show that an explanation can pass the checks used to trust it and still be wrong enough to cost money. We define eight checks for any forecaster that states a plan lift, six with a pass rule fixed before any result, and run them on a world model and on LightGBM. In generated store data with known effects, the world model passes the checks of construction, stability, price direction and agreement with sales and with LightGBM, yet when merchants plan into high-demand weeks it states 1.33 to 1.40 times the true lift, and 1.23 to 1.42 times in eight variants of that world; LightGBM overstates it too (1.26, and 1.16 to 1.35). Both still pick the right weeks to promote, but stock ordered to the world model's lift is off by 0.44 to 0.48 of the true lift. The world model's stated response to a lasting regular-price change is 4.7 to 6.5 times the true -0.5, an error in kind that only a measured cause finds. Sanity checks for explanations test whether an explanation depends on the model; a decision needs to know whether it is right about the world, and these results show the first does not give the second. For the final tuned world models of our companion paper on nine data sets, baseline and lift add up under each model's own plan on every window, but a deeper price cut lowers the forecast in 29% to 83% of item-week steps on Dominick's. Across 703 configurations from the settings searches, checks passed were not related to accuracy (Spearman 0.02, 95% interval -0.02 to 0.05). A noisy benchmark of price episodes in Dominick's data is reported as a check of direction only.
Comments: 23 pages. Version 2: abstract and introduction revised; results unchanged. Code and data: doi:https://doi.org/10.5281/zenodo.24271672
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.20811 [cs.LG]
  (or arXiv:2611.20811v2 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2611.20811

arXiv-issued DOI via DataCite

Submission history

From: Karthik Iyer [view email]
[v1] Mon, 16 Nov 2026 09:57:40 UTC (382 KB)
[v2] Tue, 17 Nov 2026 09:28:14 UTC (382 KB)

来源:arXiv cs.AI · arxiv.org