跳到正文
arXiv cs.AI· Junxin Wang, Yingfeng Luo, Xiangchen Song, Weiqiao Shan, Runsong Zhao, Xinyu Liu, Shunjie Xing, Yifu Huo, Dingyang Lin, Qiuyu Gu, Yongyu Mu, Chenglong Wang, Changliang Li, Jingbo Zhu, Tong Xiao·· 2 小时前AI 评分33

PEAR:面向大视觉语言模型感知与探索的自适应优势重塑方法

PEAR: Adaptive Advantage Reshaping for Perception and Exploration in Large Vision-Language Models

AI 导读

论文提出 PEAR,一种用于多模态推理的自适应优势重塑方法,解决以往将 token 熵按视觉依赖缩放会导致高熵、低视觉依赖 token 被低估的问题。PEAR 保留视觉依赖作为基础信号,仅在高熵位置叠加熵驱动的探索增益,融合信号映射为 token 级权重以重塑序列级优势。

正文 · 原文

Authors:Junxin Wang, Yingfeng Luo, Xiangchen Song, Weiqiao Shan, Runsong Zhao, Xinyu Liu, Shunjie Xing, Yifu Huo, Dingyang Lin, Qiuyu Gu, Yongyu Mu, Chenglong Wang, Changliang Li, Jingbo Zhu, Tong Xiao

View PDF HTML (experimental)

Abstract:Effective multimodal reasoning requires a model to reliably utilize visual information while sufficiently exploring diverse reasoning paths. To achieve this goal, prior work combines visual dependency and token entropy to reshape sequence-level advantages, but scaling the contribution of token entropy by visual dependency can leave high-entropy tokens with low visual dependency underweighted, despite their important role in reasoning exploration. To address this limitation, we propose PEAR, an adaptive advantage reshaping method for improving perception and exploration in multimodal reasoning. PEAR retains visual dependency as the base signal and adds an entropy-based exploration gain only at high-entropy positions, with lower visual dependency leading to a larger additional gain. The fused signal is then mapped to positive token-level weights that reshape the sequence-level advantage. Experiments on Qwen2.5-VL-3B/7B show that PEAR achieves the highest average performance among evaluated baselines across multimodal reasoning benchmarks, alongside leading results on textual reasoning and general multimodal benchmarks.
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.32216 [cs.AI]
  (or arXiv:2610.32216v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.32216

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Junxin Wang [view email]
[v1] Fri, 23 Oct 2026 06:14:15 UTC (2,902 KB)

来源:arXiv cs.AI · arxiv.org