arXiv cs.AI· Arnesh Batra, Aniket Khandelwal, Jashn Khemani, Krish Thukral, Arush Gumber, Denis Federico Lim, Ujwal Kumar, Phan Xuan Tan·· 4 小时前AI 评分50
MAD Bench 揭示 LLM 多智能体辩论中谁说服了谁
Who Convinced Whom? Tracing How LLMs Change Their Minds in Multi-Agent Systems
AI 导读
一篇 arXiv 论文提出 MAD Bench 基准，包含 2,400 道覆盖知识推理、价值道德与安全拒绝的题目，以轮次匹配的独立反思对照研究多智能体辩论（MAD）如何改变语言模型决策。
正文 · 原文
Abstract:Multi-agent debate (MAD) aims to improve language-model decisions through the exchange of arguments, yet agreement after debate need not reflect independent corroboration. We investigate how peer communication influences individual decisions and collective outcomes through behavioral and internal interventions. We introduce MAD Bench, a 2,400-question benchmark spanning knowledge and reasoning, values and moral judgment, and safety and refusal, and evaluate three open-weight models using a round-matched independent-reflection control. Among answer-changing responses, a forced-choice readout before rationale generation matches the eventual answer more often in debate than in reflection (65.4% versus 22.3% on Qwen3.5-9B). Message ablations reveal model-dependent effects of peer answers and reasoning, while attributing identical text to the receiver rather than another agent substantially changes its influence. For the tested source descriptions, stated track record affects answer preferences more strongly than professional-status cues across all three models. Attention masking produces different changes in decision margins across the three checkpoints. On fully parsed, reference-labelled non-numeric questions, debate yields small estimated accuracy improvements over initial majority voting, while increasing the rate of unanimous wrong answers by 3.1-7.4 percentage points relative to reflection. Longer debates show persistent consensus and greater correlation between agents' correctness than reflection. These findings show that stronger consensus can coexist with more shared errors, motivating evaluations that assess dependence and unanimous errors alongside accuracy.
| Subjects: | Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.35930 [cs.MA] |
| (or arXiv:2610.35930v1 [cs.MA] for this version) | |
| https://doi.org/10.48550/arXiv.2610.35930 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Aniket Khandelwal [view email]
[v1]
Sun, 18 Oct 2026 16:04:25 UTC (293 KB)
来源：arXiv cs.AI · arxiv.org