Hugging Face Daily Papers· Hongcan Guo, Yian Zhao, Feng Wang, Shen Nie, Guoqiang Wei, Yan Zeng, Hengshuang Zhao·· 2 天前AI 评分40
Cola2：连续语义压缩与离散生成协同的层次化语言建模框架
Cola2: Co-Adaptive Hierarchical Language Modeling with Continuous Semantic Compression and Balanced Discrete Generation
AI 导读
研究者提出 Cola2 框架，将连续语义建模与离散文本生成分离并协同适配，通过动态语义分段、辅助损失无关的负反馈控制压缩率，并训练 block-causal masked diffusion 解码器。