arXiv cs.AI· Philippe Forest, Giulia Lioi, Mai Pham Quyen, Alix Lamouroux, Javen Shi, Adrien Merlini·· 1 小时前AI 评分45
GALA:面向真实场景 EEG 视觉解码的画廊级对齐方法
GALA: Gallery-Level Alignment for Real-Life Vision Decoding from EEG
AI 导读
arXiv 论文提出 GALA(GAllery-Level Alignment),一种无标签校准方法,通过 shrinkage whitening、hubness 校正和 Sinkhorn–Procrustes 对齐,将用户未标注 EEG 嵌入映射到已知候选图像画廊上。
正文 · 原文
Abstract:Neural decoding of visual experience from electroencephalography (EEG) has achieved strong performance in intra-subject settings, but current methods fail to generalize across individuals: on the standard 200-way benchmark THINGS-EEG-2, top-1 accuracy drops from above 80% within subjects to about 32% for an unseen subject. Adapting a pre-trained encoder to new subjects and sessions typically requires labeled data, a bottleneck whose collection time severely limits practical device deployment. In a practical Brain-Computer Interface (BCI), however, the possible outcomes are known in advance and form a gallery of candidates, and the unlabeled EEG of the user accumulates as soon as the device is used. We propose a new setting, incremental transductive calibration, in which the decoder is calibrated regularly on all the unlabeled EEG received so far and on the known gallery, without any labels. This setting is closer to the conditions of a deployed BCI than the zero-shot and batch evaluations in current use. We evaluate it with a protocol in which queries arrive one at a time, with unknown and possibly unequal frequencies, and each query is decoded before it is used for calibration. In this setting, we introduce GALA : GAllery-Level Alignment, a label-free calibration method which registers the unlabeled EEG embeddings onto the gallery through shrinkage whitening, hubness correction and a Sinkhorn--Procrustes alignment with query frequencies estimated from the buffer, updated after every query. On THINGS-EEG-2, with a gallery of 200 images, it raises the top-1 accuracy on a new subject from 28% to 67% over 53 minutes of use. Across 60 evaluation settings that vary the gallery size, the query frequencies and the number of repetitions averaged per query, GALA is the most accurate label-free method in every setting, 6.6 points above the best competing method on average at the end of the stream.
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.24206 [cs.AI] |
| (or arXiv:2611.24206v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.24206 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Philippe Forest [view email]
[v1]
Wed, 18 Nov 2026 10:40:59 UTC (833 KB)
来源:arXiv cs.AI · arxiv.org