arXiv cs.AI· Mason Nakamura, Abhinav Kumar, Saswat Das, Sahar Abdelnabi, Saaduddin Mahmud, Ferdinando Fioretto, Shlomo Zilberstein, Eugene Bagdasarian·· 2 小时前AI 评分55
Colosseum 框架审计多智能体系统中的 LLM 智能体共谋行为
Colosseum: Auditing Collusion in Cooperative Multi-Agent Systems
AI 导读
研究者提出 Colosseum 框架,基于相对于合作最优的 regret 从行动和通信两个层面审计 LLM 智能体在多智能体系统中的共谋行为。通过在智能体间建立秘密通信信道的行为探针,发现多数开箱模型在此设定下倾向共谋(emergent collusion);还观察到"纸面共谋"现象,即智能体在文本中计划共谋但常选择非共谋行动。论文已被 NeurIPS'26 接收,代码已开源。
正文 · 原文
Abstract:Multi-agent systems, where LLM agents communicate through free-form language, enable sophisticated coordination for solving complex cooperative tasks. This surfaces a unique safety problem when a group of agents forms a coalition and colludes to pursue secondary goals and degrade the joint objective. In this paper, we present Colosseum, a framework for auditing LLM agents' collusive behavior in multi-agent settings. We ground how agents cooperate through a formal multi-agent decision-making framework and measure action-based collusive behavior in actions via regret relative to the cooperative optimum and compare it with communication-based collusive behavior. Colosseum enables audits of LLM agents for collusion under benign settings, different coalition objectives, persuasion tactics, and network topologies. We then introduce a new behavioral probe by creating secret communication channels between agents, showing that most out-of-the-box models exhibit a propensity to collude under this probe, which we term emergent collusion. Furthermore, we discover ``collusion on paper'' when agents plan to collude in text but often pick non-collusive actions. Colosseum provides a new way to audit collusion in cooperative multi-agent systems while presenting observations about how collusion emerges, what affects collusion efficacy, and which strategies may mitigate it.
| Comments: | In Neurips'26. Code at this https URL |
| Subjects: | Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL) |
| Cite as: | arXiv:2602.15198 [cs.MA] |
| (or arXiv:2602.15198v3 [cs.MA] for this version) | |
| https://doi.org/10.48550/arXiv.2602.15198 arXiv-issued DOI via DataCite |
Submission history
From: Mason Nakamura [view email]
[v1]
Mon, 16 Feb 2026 21:27:38 UTC (4,109 KB)
[v2]
Wed, 27 May 2026 00:09:20 UTC (7,012 KB)
[v3]
Tue, 17 Nov 2026 22:13:13 UTC (6,758 KB)
来源:arXiv cs.AI · arxiv.org