测试时自适应下平衡准确率无法识别的神经信号解码问题
What Balanced Accuracy Cannot Identify in Neural-Signal Decoding under Test-Time Adaptation
AI 导读
一项 arXiv 论文研究测试时自适应(TTA)在神经信号分类中的盲点:在 Siena/EEG、PTB-XL/ECG、Sleep-EDF/EEG 共 11 个数据集-编码器组合上评估 full_ttt。
正文 · 原文
Abstract:Adaptation for neural-signal classification is usually transductive: each batch is scored after updating on it, and the gain depends on the adapted model [4]. This paper asks what an aggregate change fails to characterise inside the cohort. Full test-time adaptation (full_ttt) was evaluated in 11 dataset-encoder cells (four each on Siena/EEG and PTB-XL/ECG, three on Sleep-EDF/EEG), with splits and source-model evaluation fixed; the subject was the unit, exact sign tests were Holm-corrected and conditional on the shared stream, and bootstrap intervals accompanied a dependence audit. Two results of different kinds follow. In the binary case balanced accuracy gives a one-class decoder the same value as one reporting both classes at 50%, so the aggregate cannot identify a class that stopped being reported; a class covering a tenth of a subject's samples went unpredicted in 26-47 of 112 subject-cells, against 7-9 for the controls, which is a descriptive count. With cohort, split and update rule fixed, the within-subject class contrast follows the encoder, tested directly rather than inferred from tests against zero: two of six Siena encoder pairs survive the dependence readings at their nominal reference and one at a fold-level reference, while two of ten Sleep-EDF stage pairs pass the run-clustered gate at its nominal reference; aggregate and contrast named different encoders in 10 of 11. The protocol bounds both results, since a stream-interleaving effect reverses sign with state sharing (+3.5 to -2.4 pp). An aggregate score can hide individual harm, as [1] showed, but it cannot distinguish a uniform loss from a deleted class; class-level change should therefore be reported alongside the aggregate and subject-level change alongside it, with both results conditional on the cell, the rule and the stream construction.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.17925 [cs.AI] |
| (or arXiv:2611.17925v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.17925 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jiangshuo Xie [view email]
[v1]
Fri, 13 Nov 2026 09:04:14 UTC (19,389 KB)
来源:arXiv cs.AI · arxiv.org