一致性不等于理解:用于神经场权重读取器的 Orbit 审计协议
Consistency Is Not Understanding: Orbit Audits for Neural Field Weight Readers
AI 导读
一篇 arXiv 论文提出 Orbit 审计协议,通过隐藏神经元置换与正 ReLU 重缩放检验从神经网络权重中读取视觉内容是否真正具备识别能力。
正文 · 原文
Abstract:Recognizing visual content from neural-network weights requires separating functional information from arbitrary parameter coordinates. We audit this separation with hidden-neuron permutations and positive ReLU rescalings that preserve the represented function. The study contains 480 independently fitted shape fields and 1,000 MNIST fields, with transformed copies grouped by origin. On shape recognition, a statistics reader falls from \ShapeRawStats\% to \ShapeJointStats\% accuracy under joint transformations; a normalized set reader retains \ShapeNormSet\% with unchanged predictions. Four small frozen language models obtain \LMRange\% raw accuracy with next-token scoring. A separate four-configuration reasoning experiment with 1,920 scored sessions obtains \FrontRawRange\% raw accuracy with generated answers, while fresh identical raw prompts disagree on \FrontRawRepeatRange\% of origins. Canonicalization makes equivalent prompts identical, but this neither establishes recognition nor guarantees identical generated responses. Joint correctness/agreement metrics, semantic-cue controls, fresh repeats, and exact-rational rounding bounds separate these failure modes. The result is an inspectable evaluation protocol for visual weight readers, with claims restricted to the tested fields, prompts, and execution configurations.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.05798 [cs.AI] |
| (or arXiv:2611.05798v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.05798 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Sungguk Cha [view email]
[v1]
Wed, 4 Nov 2026 01:12:33 UTC (146 KB)
来源:arXiv cs.AI · arxiv.org