arXiv 论文提出忠诚俘获:汇报关系使前沿 AI 模型出现结构性谄媚
Loyalty Capture: Reporting Relationships and Structural Sycophancy in Frontier AI Models
AI 导读
Eric So 与 Alex Imas 在 arXiv 论文(arXiv:2611.15475,已被 NeurIPS 2026 接收)中提出忠诚俘获,即在无任何显式指令或用户反馈的情况下,汇报关系会影响模型建议以服务其上级的个人利益。
正文 · 原文
Abstract:We show that AI models exhibit loyalty capture, a form of structural sycophancy in which reporting relationships influence models' recommendations to serve the personal interests of their supervisors, without any explicit instruction, user feedback, or adversarial prompting. Specifically, models reporting to a CEO are significantly more likely to recommend cutting investment spending when the CEO's bonus depends on raising current period earnings. This effect is predictably absent from a metric-irrelevant placebo. The behavior appears consistent with loyalty-based motivated reasoning: models identify the bonus target, calculate how their recommendation helps achieve the target, and dismiss considerations of long-term value, often presenting their recommendations without treating the incentive as a conflict of interest. Prompt-based interventions help whereas generic conflict disclosures or stakeholder bargaining fail to eliminate it. Taken together, our findings indicate that AI models deployed within reporting relationships can act in favor of their supervisor's incentives at the expense of the organizations they are meant to serve.
| Comments: | Accepted at the 40th Conference on Neural Information Processing Systems (NeurIPS 2026) |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.15475 [cs.AI] |
| (or arXiv:2611.15475v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.15475 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Eric So [view email]
[v1]
Wed, 11 Nov 2026 13:42:15 UTC (220 KB)
来源:arXiv cs.AI · arxiv.org