跳到正文
arXiv cs.AI· Siqi Xiang, Zhipeng Xu, Shengrui Liu, Zulong Chen, Chunyan Miao, Shijian Lu·· 1 小时前AI 评分39

RAA:用分辨率作为注意力机制实现高效智能体记忆感知

Resolution as Attention for Efficient Agent Memory Perception

AI 导读

arXiv 论文提出 Resolution as Attention(RAA),将过往交互渲染为图像,用视觉分辨率作为跨交互历史的注意力分配手段,关键交互保留细粒度信息、次要交互降低视觉 token 消耗。

正文 · 原文

View PDF HTML (experimental)

Abstract:LLM-based agents accumulate extensive interaction histories when solving complex, long-horizon tasks, making efficient memory management critical to their performance and scalability. While existing memory management methods primarily focus on what to retain or retrieve, they often overlook how much perceptual detail should be allocated to individual past interactions. We posit that effective agent memory depends not only on the information preserved, but also on the granularity at which each past interaction is perceived. Motivated by this insight, we propose Resolution as Attention (RAA), a memory perception mechanism that uses visual resolution as a means of attention allocation across interaction histories. RAA renders past interactions as images and dynamically adjusts their resolution at every step according to their relevance to the agent's upcoming decision, preserving fine-grained information for critical interactions while reducing visual-token consumption for less relevant ones. To adaptively determine the perceptual fidelity of each interaction, we train a lightweight relevance estimator with teacher-model guidance and further optimize it to preserve the agent's decision consistency at a reduced visual-token cost. Experiments across multiple tasks and backbones show that RAA reduces token consumption by over 50% without compromising task performance. Moreover, RAA can be integrated as a plug-in perception layer with existing memory management methods, yielding further token savings and revealing adaptive perception as a complementary dimension of agent memory.
Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2611.24422 [cs.AI]
  (or arXiv:2611.24422v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.24422

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Siqi Xiang [view email]
[v1] Wed, 18 Nov 2026 13:43:16 UTC (950 KB)

来源:arXiv cs.AI · arxiv.org