受控部分神经坍缩用于长尾识别:全坍缩并非最优
Full Collapse Is Suboptimal: Controlled Partial Neural Collapse for Long-Tailed Recognition
AI 导读
一项被 WACV 2027 接收的研究提出受控部分神经坍缩方法,解决长尾识别中强制尾部类完全坍缩导致过收缩、损害泛化的问题。方法包含 CASA 分类器和 ETF-AM 损失,让头部类沿 ETF 坍缩而尾部类保留类内多样性。在 CIFAR100-LT、ImageNet-LT、Places-LT 和 iNaturalist-2018 上取得优于此前方法的最佳整体准确率。
正文 · 原文
Abstract:Recent long-tailed recognition (LTR) methods incorporate neural collapse (NC) and align features to a fixed Equiangular Tight Frame (ETF) as a uniform target for all classes. However, forcing tail classes to fully collapse over-contracts their samples and weakens generalization. To address this, we propose a controlled partial neural collapse, realized through two coordinated controls on a backbone: the Class-Adaptive Sparse Activation (CASA) classifier and the ETF-constrained adaptive margin (ETF-AM) loss. Rather than forcing a uniform full collapse, this regime allows head classes to collapse along the ETF while tail classes retain within-class diversity. This prevents the tail from being forced into full collapse, which is suboptimal under imbalance. To set the dimensionality of collapse, CASA induces class-related node specialization through feature-conditioned gating so that tail classes occupy their own feature directions. For the clearance axis, ETF-AM applies a frequency-adaptive margin, with smaller margins for head classes and larger for tail classes. On CIFAR100-LT, ImageNet-LT, Places-LT, and iNaturalist-2018, our method achieves the best overall accuracy over prior methods. In the empirical analysis, within-class spread increases monotonically from head to tail classes, consistent with tail classes retaining variability rather than fully collapsing.
| Comments: | Accepted at WACV 2027 |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.36460 [cs.CV] |
| (or arXiv:2610.36460v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2610.36460 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Hyeontaek Hwang [view email]
[v1]
Tue, 27 Oct 2026 01:09:29 UTC (1,628 KB)
来源:arXiv cs.AI · arxiv.org