跳到正文
arXiv cs.AI· Hyeontaek Hwang, Cheonghwan Hur, Daeyoung Kim·· 3 小时前AI 评分18

受控部分神经坍缩用于长尾识别:全坍缩并非最优

Full Collapse Is Suboptimal: Controlled Partial Neural Collapse for Long-Tailed Recognition

AI 导读

一项被 WACV 2027 接收的研究提出受控部分神经坍缩方法,解决长尾识别中强制尾部类完全坍缩导致过收缩、损害泛化的问题。方法包含 CASA 分类器和 ETF-AM 损失,让头部类沿 ETF 坍缩而尾部类保留类内多样性。在 CIFAR100-LT、ImageNet-LT、Places-LT 和 iNaturalist-2018 上取得优于此前方法的最佳整体准确率。

正文 · 原文

View PDF HTML (experimental)

Abstract:Recent long-tailed recognition (LTR) methods incorporate neural collapse (NC) and align features to a fixed Equiangular Tight Frame (ETF) as a uniform target for all classes. However, forcing tail classes to fully collapse over-contracts their samples and weakens generalization. To address this, we propose a controlled partial neural collapse, realized through two coordinated controls on a backbone: the Class-Adaptive Sparse Activation (CASA) classifier and the ETF-constrained adaptive margin (ETF-AM) loss. Rather than forcing a uniform full collapse, this regime allows head classes to collapse along the ETF while tail classes retain within-class diversity. This prevents the tail from being forced into full collapse, which is suboptimal under imbalance. To set the dimensionality of collapse, CASA induces class-related node specialization through feature-conditioned gating so that tail classes occupy their own feature directions. For the clearance axis, ETF-AM applies a frequency-adaptive margin, with smaller margins for head classes and larger for tail classes. On CIFAR100-LT, ImageNet-LT, Places-LT, and iNaturalist-2018, our method achieves the best overall accuracy over prior methods. In the empirical analysis, within-class spread increases monotonically from head to tail classes, consistent with tail classes retaining variability rather than fully collapsing.
Comments: Accepted at WACV 2027
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.36460 [cs.CV]
  (or arXiv:2610.36460v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2610.36460

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Hyeontaek Hwang [view email]
[v1] Tue, 27 Oct 2026 01:09:29 UTC (1,628 KB)

来源:arXiv cs.AI · arxiv.org