结果感知智能体:因果结构何时能帮助前向模型预见动作后果?
Outcome-Aware Agents: When Does Causal Structure Help a Forward Model Foresee the Consequences of Actions?
AI 导读
该 arXiv 研究考察因果结构何时能帮助学习型前向模型预测动作后果,提出 AC-LSCM(Action-Conditioned Latent Structural Causal Model),在动作模拟多步结果不安全时予以拒绝。
正文 · 原文
Abstract:Agents that act on real systems should predict what their actions will cause before acting. We study when causal structure helps a learned forward model do this, using a planner that rejects candidate actions whose simulated multi-step outcome is unsafe, in synthetic structural causal models where the true consequences are known. We compare the Action-Conditioned Latent Structural Causal Model (AC-LSCM: per-factor mechanisms over a learned sparse graph, actions as do-interventions) with three unstructured forward models on seven random graphs with 10 or 20 variables, a task configured by a fixed rule, and two controls: a do-wrapper that gives every model the same action semantics, and counterfactual data given to all models or to none. When its factors are the observed variables, AC-LSCM recovers the true graph exactly on every 10-variable graph and has lower three-step prediction error than every baseline in all 396 paired comparisons. Its excess safety violations over an oracle are 0.25 of the no-model level on 10-variable graphs (best baseline 0.31) and 0.41 on 20-variable graphs (0.53), and its margin is largest for two-variable actions never seen in training (0.18 versus 0.28). With learned latent factors the same model is worse than the baselines; the choice of factors matters more than the explicit do-operator or counterfactual data, and every planner stays far from the oracle. This version corrects an earlier one, whose model learned an empty graph and whose headline 36x safety improvement came from a task that tested only extrapolation of action values; we withdraw that claim. Code and all per-seed results are released.
| Comments: | 16 pages, 7 tables. Revised and corrected version of the preprint at this https URL (withdraws its 36x safety claim). Code and per-seed results: this https URL |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.34385 [cs.LG] |
| (or arXiv:2610.34385v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.34385 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Mallesh Madapathi [view email]
[v1]
Sun, 25 Oct 2026 15:39:57 UTC (21 KB)
来源:arXiv cs.AI · arxiv.org