跳到正文
arXiv cs.AI· Xiaopeng Chu, Wenzheng Kong, Wei Liu, Wenyi Zhang·· 2 小时前AI 评分53

FLCVA 论文对自适应推理做全账本反事实审计

A Full-Ledger Counterfactual Audit of Adaptive Reasoning

AI 导读

论文提出 Full-Ledger Counterfactual Value Audit(FLCVA),比较即时回答与同一冻结前缀的四条固定长度续写并计入所有信号成本。

正文 · 原文

View PDF HTML (experimental)

Abstract:Adaptive reasoning must decide whether to answer now or spend more compute. Predicting that the current answer is wrong does not establish whether further reasoning will improve it. We introduce the Full-Ledger Counterfactual Value Audit (FLCVA), which compares an immediate answer with four fixed-length continuations from the same frozen prefix under one answer procedure and accounts for the cost of every signal used by a policy. On GSM8K and MATH-500, a random 256-token continuation recovers a wrong answer in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging a correct answer in 1.4% and 1.9%. Correctness labels from independently sampled continuations predict a separate continuation's outcome in both primary models. In offline replay, using these labels to allocate compute improves performance on DeepSeek; the Qwen3 gain remains inconclusive. Under full cost accounting, the tested lightweight, myopic controllers mainly recognize current errors and add little continuation-specific value beyond that shortcut. A Llama-8B replication and action/cost ablations examine the robustness of these findings. FLCVA separates measuring local continuation value, predicting it from observable signals, and using those predictions to allocate computation.
Comments: Accepted to EACL 2027 (Main Conference)
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as: arXiv:2611.22778 [cs.AI]
  (or arXiv:2611.22778v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.22778

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Xiaopeng Chu [view email]
[v1] Tue, 17 Nov 2026 13:44:33 UTC (1,619 KB)

来源:arXiv cs.AI · arxiv.org