不完全信息博弈中的学习与引导
Learning and Steering in Incomplete-Information Games
AI 导读
arXiv 论文研究 mediator 在不知道智能体效用的前提下,仅凭轨迹反馈学习未知博弈并引导其走向最大化自身效用的结果。
正文 · 原文
Abstract:In many modern multi-agent systems, a mediator seeks to influence strategic decision dynamics using only outcome-level feedback and without knowing agents' utilities. In this work, we study how a mediator can learn an unknown game and steer adaptive agents toward outcomes that maximize her utility using only trajectory feedback. The mediator knows the game form and her own objective, but not the agents' utilities. Moreover, she commits to nonnegative payments and provides recommendations and contexts, but receives only a single realized terminal outcome rather than full-information feedback. We develop halving-type algorithms that learn utility differences in normal-form games and conditional continuation-value differences in extensive-form games, achieving a sample complexity of $\widetilde O(\varepsilon^{-2})$ that matches worst-case lower bounds up to logarithmic factors. We then combine these learning procedures with a Lagrangian formulation in an online Learn-Compute-Steer algorithm that interleaves learning, equilibrium computation, and steering toward mediator-optimal extensive-form correlated equilibria (EFCE). With high probability, the Learn-Compute-Steer algorithm achieves a directness gap and an optimality gap of $\widetilde O(T^{-1/4})$, while time-average payments are of $\widetilde O(T^{-1/8})$.
| Comments: | 57 pages, 5 figures |
| Subjects: | Computer Science and Game Theory (cs.GT); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC) |
| Cite as: | arXiv:2611.07589 [cs.GT] |
| (or arXiv:2611.07589v1 [cs.GT] for this version) | |
| https://doi.org/10.48550/arXiv.2611.07589 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Asrin Efe Yorulmaz [view email]
[v1]
Thu, 5 Nov 2026 07:40:05 UTC (306 KB)
来源:arXiv cs.AI · arxiv.org