DelegateEval：评估个人外部服务 AI 智能体平台的框架
DelegateEval: Evaluating Platforms for Personal External Service Agents
AI 导读
arXiv 论文提出 DelegateEval，一个面向个人外部服务智能体平台的评估框架，此类智能体由个人授权并持续管理，借助其知识与方法为客户提供服务。框架涵盖易创建性、服务发现与匹配、交付质量、专长传承、服务连续性、学习与改进、可靠性与治理、效率与价值共八个维度，可评估结合大语言模型、可复用技能与 MCP 等协议的平台。
正文 · 原文
Abstract:AI agents that work for an individual over time may also help that individual serve external clients. We define a personal external service agent as an agent authorized and continuously managed by a specific individual to accept client requests, deliver work, and provide ongoing support using that person's knowledge, experience, professional methods, and service boundaries. Such agents could allow individuals to serve more clients with less direct involvement and generate economic value at scale. We propose DelegateEval, a platform-level evaluation framework for agent systems that may combine large language models, reusable skills, protocols such as MCP, and executable tool environments. It covers eight dimensions: ease of creation, service discovery and matching, delivery quality, expertise inheritance, service continuity, learning and improvement, reliability and governance, and efficiency and value. These dimensions assess whether a platform enables people with different backgrounds to turn their expertise into ongoing services that deliver verifiable work, develop capabilities through experience, and remain economically feasible. We present the framework and an experimental design. Complete datasets, executable environments, a unified scoring protocol, and cross-model results remain to be developed and empirically validated.
| Comments: | 28 pages, 7 figures, 6 tables. Evaluation framework and experimental design |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.07508 [cs.AI] |
| (or arXiv:2611.07508v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.07508 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jichao Li [view email]
[v1]
Thu, 5 Nov 2026 06:13:41 UTC (469 KB)
来源：arXiv cs.AI · arxiv.org