跳到正文
arXiv cs.AI· Jakub Strawa·· 4 小时前AI 评分38

TRIBE v2 多模态脑响应模型的皮层拓扑组织 in-silico 审计

An In-Silico Audit of Topographic Organization in a Multimodal Brain-Response Model

AI 导读

一项 in-silico 审计检验 TRIBE v2(d'Ascoli et al., 2026)预测 fMRI 皮层响应时是否保留经典拓扑组织。

正文 · 原文

View PDF HTML (experimental)

Abstract:TRIBE v2 (d'Ascoli et al., 2026) predicts fMRI responses across the cortical surface from video, audio and text. Its authors validated it with category-selective localizers (faces, places, bodies, words) and language contrasts, but not with the classic topographic organization of sensory cortex: retinotopy, tonotopy, and motion selectivity in area MT+. There is a clear architectural reason to expect retinotopy to fail: TRIBE's video features are averaged over space before the response head, which should discard visual-field position. I present mapping stimuli, a fitting pipeline adapted from standard fMRI mapping analyses, and a stand-in model with known ground truth that serves as a positive and negative control, and apply them to TRIBE v2's predictions, comparing the fitted maps with human atlases using spin tests. TRIBE v2 shows a sharp split. There is no contralateral hemifield response and no polar-angle map, robustly across stimulus controls. There is no tonotopic gradient in primary auditory cortex: best frequencies span an interquartile range of only 0.14 octaves across core and belt, and the null persists with loudness-equalized tones. An eccentricity-like gradient appears only when the ring geometry changes, consistent with global image statistics rather than a positional code. In contrast, motion selectivity is strong and precisely localized: 22% of the 1% most motion-selective vertices fall in MT+, which covers 0.42% of cortex. In-silico experiments that depend on feature identity appear viable with TRIBE v2, while those that depend on visual-field or frequency position are not supported by the current model.
Comments: 12 pages, 5 figures, 4 tables. Code and stimuli: this https URL
Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.18105 [q-bio.NC]
  (or arXiv:2611.18105v1 [q-bio.NC] for this version)
  https://doi.org/10.48550/arXiv.2611.18105

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Jakub Strawa [view email]
[v1] Fri, 13 Nov 2026 12:32:56 UTC (1,046 KB)

来源:arXiv cs.AI · arxiv.org