跳到正文
arXiv cs.AI· Ziluowen Luo, Ruochen Liu, Jun Yin, Hao Yan, Zhengxuan Hu, Xinze Shi, Chaozhuo Li, Chengqi Zhang, Senzhang Wang·· 3 小时前AI 评分37

词汇表已经现成:复用预训练可解释特征做生成式推荐的 API 框架

The Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation

AI 导读

arXiv 论文提出 API 框架,将预训练稀疏自编码器带语义标注的特征索引直接复用为生成式推荐的语义 ID(SID)词表,免去额外的词表拟合训练。其 Pretrained Interpretable IDs(PIDs)保留特征索引与激活强度区分物品,Semantic Prediction Adapter(SPA)通过联合预测特征索引和强度学习用户偏好并对候选物品排序。

正文 · 原文

View PDF HTML (experimental)

Abstract:Generative recommendation (GR) predicts the next item through its semantic ID (SID). Existing methods commonly fit SID vocabularies to pretrained language model (PLM) representations of item descriptions, incurring additional training costs and making vocabulary coverage dependent on the fitting domains. We observe that pretrained sparse autoencoders expose PLM features with human-interpretable semantic annotations, allowing feature indices to serve as a reusable SID vocabulary. However, reusing this vocabulary requires preserving item distinctions under compact token budgets and learning to favor target items over candidates with shared dominant features. It also requires extending feature interpretability from item content to retrieval decisions. To address these challenges, we propose API, a framework that Adapts the Pretrained Interpretable vocabulary for effective and explainable GR without additional vocabulary learning. Within API, Pretrained Interpretable IDs (PIDs) retain selected feature indices and relative activation strengths for item discrimination. With PIDs as supervision, the Semantic Prediction Adapter (SPA) learns user preferences from interaction histories through joint feature-index and strength prediction. SPA combines both predictions to score candidate items, with item-level supervision encouraging the observed next item to outrank its alternatives. API further explains candidate score differences through feature contributions paired with their pretrained semantic annotations. Extensive experiments show that API achieves competitive performance across backbones and decoding schemes, while preserving item distinctions under compact token budgets and enabling explainable retrieval.
Comments: 13 pages, 8 figures, 7 tables
Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.36763 [cs.IR]
  (or arXiv:2610.36763v1 [cs.IR] for this version)
  https://doi.org/10.48550/arXiv.2610.36763

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Ziluowen Luo [view email]
[v1] Tue, 27 Oct 2026 07:19:35 UTC (1,808 KB)

来源:arXiv cs.AI · arxiv.org