arXiv cs.AI· Yuxiang Wang, Baojian Zhou, Qifang Zhao, Keyue Jiang, Yanghua Xiao, Xiaoxiao Xu·· 3 小时前AI 评分43
ProtAgent:用交互级信用分配后训练紧凑型蛋白质工具智能体
ProtAgent: Post-Training Compact Protein Tool Agents with Interaction-Level Credit Assignment
AI 导读
研究提出 ProtAgent,一个两阶段后训练流程,用 SFT 学习工具接口、on-policy REINFORCE 优化交互策略,并引入动作奖励与步级回报的交互级信用分配。
正文 · 原文
Abstract:Protein annotation agents must choose suitable bioinformatics tools, interpret their outputs, and use the resulting evidence in the final answer. Most existing systems rely on frontier-scale models. We ask whether a compact model can instead learn this behavior through post-training with real tool interaction. We present ProtAgent, a two-stage pipeline that uses supervised fine-tuning (SFT) to learn the tool interface and standard on-policy REINFORCE to improve the interaction policy. Intermediate tool calls receive action rewards, and the final response receives a terminal answer reward. Step-level returns assign these rewards to the responses that produced them and to preceding actions. The episode-level baseline instead assigns one episode return to every action. On a fixed closed-loop protocol with real bioinformatics tools, ProtAgent-8B achieves 61.00% success under the annotation-coverage metric, compared with 41.60% for DeepSeek-V3.2-Thinking 671B and 60.80% for the strongest evaluated frontier system. In the three-seed comparison, mean success is 42.70% with episode-level returns and 61.40% with step-level returns under identity return normalization; the corresponding group-relative results are 36.50% and 58.20%. The metric measures recovery of reference annotations under this protocol; it does not by itself establish biological correctness or complete evidence grounding.
| Comments: | 20 pages, 2 figures |
| Subjects: | Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.33746 [q-bio.QM] |
| (or arXiv:2610.33746v1 [q-bio.QM] for this version) | |
| https://doi.org/10.48550/arXiv.2610.33746 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yuxiang Wang [view email]
[v1]
Sat, 24 Oct 2026 15:42:13 UTC (270 KB)
来源:arXiv cs.AI · arxiv.org