AUCGR:用 AUC 统一判别排序与生成重建的视觉表示学习方法
When AUC Meets Generative Reconstruction: A Unified Principle for Balanced Visual Representation Learning
AI 导读
一篇 arXiv 论文提出将生成重建重构为生成输出流形上的判别排序问题的统一表示学习范式,以缓解对比学习与生成重建目标的梯度冲突。具体方法包括优化 AUC 的 AUCGR 和聚焦可靠特征子空间内失配比较的 pAUCGR,二者即插即用,无需修改现有生成重建框架架构。实验表明该方法同时提升判别精度与细粒度感知表示。
正文 · 原文
Abstract:Multimodal large language models (MLLMs) require visual encoders that extract fine-grained visual features while constructing semantically disentangled and discriminative representations. Conventional methodologies encounter a fundamental trade-off: contrastive learning enhances inter-class discrimination by suppressing intra-class variability, whereas generative reconstruction emphasizes perceptual fidelity but lacks explicit comparative supervision. The naive aggregation of these objectives via composite loss functions often induces optimization conflicts and instability due to gradient interference within the shared latent space. To resolve this, we introduce a unified representation-learning paradigm that reformulates generative reconstruction as a discriminative ranking problem within the generative output manifold. Our approach maintains perceptual reconstruction as a supervisory signal and integrates a ranking-based discriminative constraint by systematically ordering matched and mismatched reconstruction outputs. This formulation embeds discriminative information seamlessly into the generative process, alleviating the risk of loss competition. Specifically, we propose AUC Generative Reconstruction (AUCGR), which optimizes the area under the ROC curve (AUC) by ensuring higher scores for matched pairs than for mismatched pairs, and Partial AUC Generative Reconstruction (pAUCGR), which addresses supervision bias by focusing on mismatched comparisons within reliable feature subspaces. The proposed objectives are designed to be plug-and-play, requiring no architectural modifications to existing generative reconstruction frameworks. Theoretical analysis establishes rigorous connections to AUC/pAUC optimization and provides generalization guarantees. Extensive experiments validate that our method advances both discriminative accuracy and fine-grained perceptual representation.
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.22094 [cs.CV] |
| (or arXiv:2611.22094v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.22094 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Boyu Han [view email]
[v1]
Tue, 17 Nov 2026 02:24:09 UTC (9,775 KB)
来源:arXiv cs.AI · arxiv.org