Axis-LoRA：针对个人记忆检索探测并适配嵌入模型
Axis-LoRA: Probing and Adapting Embedding Models for Personal-Memory Retrieval
AI 导读
论文提出 Axis-LoRA，一种按轴适配器，在嵌入模型内部放置四个 LoRA 分支并通过逐查询门控组合，以弥补冻结稠密嵌入模型对时间、地点、人物、事件四轴信号编码不足的问题。
正文 · 原文
Abstract:As LLMs are increasingly asked questions about a user's personal experiences, retrieval must distinguish memories by time, place, person, and event. Current personal-memory pipelines rely on frozen dense embedding models to embed memories for retrieval, but we find that these models do not capture the four axes well. Swapping a memory's date or place barely shifts its embedding, and a trained projection on top of the frozen embedding does not recover the missing signal. The problem lives inside the model, where each axis is encoded by a distinct attention-head pattern. Guided by these findings, we propose Axis-LoRA, a per-axis adapter that places four LoRA branches inside the embedding model and combines them via a per-query gate. Across three standard embedding models evaluated on LongMemEval, ATM-Bench, and LoCoMo, Axis-LoRA improves 4-benchmark mean R@10 by $+1.28$ to $+1.56$~pp while training only a small fraction of the base parameters on a small axis-counterfactual training set. Code is available at this https URL.
| Comments: | EMNLP 2026 Main |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.07820 [cs.CL] |
| (or arXiv:2611.07820v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2611.07820 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Dohoon Kim [view email]
[v1]
Thu, 5 Nov 2026 10:59:23 UTC (1,078 KB)
来源：arXiv cs.AI · arxiv.org