TRIBE v2 多模态脑响应模型的皮层拓扑组织 in-silico 审计
An In-Silico Audit of Topographic Organization in a Multimodal Brain-Response Model
AI 导读
一项 in-silico 审计检验 TRIBE v2(d'Ascoli et al., 2026)预测 fMRI 皮层响应时是否保留经典拓扑组织。
正文 · 原文
Abstract:TRIBE v2 (d'Ascoli et al., 2026) predicts fMRI responses across the cortical surface from video, audio and text. Its authors validated it with category-selective localizers (faces, places, bodies, words) and language contrasts, but not with the classic topographic organization of sensory cortex: retinotopy, tonotopy, and motion selectivity in area MT+. There is a clear architectural reason to expect retinotopy to fail: TRIBE's video features are averaged over space before the response head, which should discard visual-field position. I present mapping stimuli, a fitting pipeline adapted from standard fMRI mapping analyses, and a stand-in model with known ground truth that serves as a positive and negative control, and apply them to TRIBE v2's predictions, comparing the fitted maps with human atlases using spin tests. TRIBE v2 shows a sharp split. There is no contralateral hemifield response and no polar-angle map, robustly across stimulus controls. There is no tonotopic gradient in primary auditory cortex: best frequencies span an interquartile range of only 0.14 octaves across core and belt, and the null persists with loudness-equalized tones. An eccentricity-like gradient appears only when the ring geometry changes, consistent with global image statistics rather than a positional code. In contrast, motion selectivity is strong and precisely localized: 22% of the 1% most motion-selective vertices fall in MT+, which covers 0.42% of cortex. In-silico experiments that depend on feature identity appear viable with TRIBE v2, while those that depend on visual-field or frequency position are not supported by the current model.
| Comments: | 12 pages, 5 figures, 4 tables. Code and stimuli: this https URL |
| Subjects: | Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.18105 [q-bio.NC] |
| (or arXiv:2611.18105v1 [q-bio.NC] for this version) | |
| https://doi.org/10.48550/arXiv.2611.18105 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jakub Strawa [view email]
[v1]
Fri, 13 Nov 2026 12:32:56 UTC (1,046 KB)
来源:arXiv cs.AI · arxiv.org