Web 研究智能体如何解读用户优先级
How Web Research Agents Interpret User Priorities
AI 导读
一项研究检验基于 OpenAI 与 Anthropic 模型构建的 Web 研究智能体如何解读用户设定的优先级。
正文 · 原文
Abstract:Web research agents gather information online and write cited reports, including financial analysis. Users can state a priority to guide this research, but a priority may not say how to judge the options, leaving the agent to choose the criteria. We examine how two such agents, built on OpenAI and Anthropic models, interpret a stated priority. In 36 runs, the agents compared Microsoft and Alphabet as businesses. Prompts asked for special attention to growth or resilience, or gave no priority. We analyzed reports, searches, returned sources and cited sources. Of the 24 reports given a priority, 21 focused on it, but their criteria varied. Under the growth priority, OpenAI reports that ranked the companies accounted for risk or predictability and favored Microsoft, while the Anthropic ones judged growth by its pace and favored Alphabet. Under the resilience priority, reports used partly different criteria, and most named Microsoft as the more resilient company. Of the search and source measures tested, only the Anthropic agent's search wording differed detectably by condition. These findings suggest evaluations should examine the criteria behind a report's judgements, not only its focus or accuracy. Interfaces could let users see and adjust those criteria.
| Subjects: | Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.22989 [cs.HC] |
| (or arXiv:2611.22989v1 [cs.HC] for this version) | |
| https://doi.org/10.48550/arXiv.2611.22989 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Parisa Suchdev [view email]
[v1]
Tue, 17 Nov 2026 16:07:00 UTC (189 KB)
来源:arXiv cs.AI · arxiv.org