跳到正文
arXiv cs.AI· Uma Kalkar, Rumman Chowdhury, Reva Schwartz, Gabriella Waters·· 3 小时前AI 评分41

如何设计有效的独立验证组织:关键制度考量分析

Key Institutional Considerations for Designing Effective Independent Verification Organizations

AI 导读

arXiv 论文提出独立验证组织(IVO)作为评估 AI 技术的两党共识方案,但制度与政策设计仍滞后于热度。论文主张 IVO 应能对前沿公司及企业级 AI 采用方在部署与使用阶段的模型、系统和应用进行情境化评估,涵盖从生存性风险到日常风险的更广谱风险,并借鉴金融服务、教育、公共卫生与科学领域既有制度,就服务对象、所需访问权限、外部治理关系、资金来源及保障生态定位给出早期考量。

正文 · 原文

View PDF HTML (experimental)

Abstract:Independent verification organizations (IVOs) have emerged as a popular, bipartisan solution for facilitating high-quality independent evaluations of AI technologies. But momentum is outpacing design: there is emerging consensus on the necessary operating conditions for robust IVOs, but little discourse on institutional and policy specifications to ensure those conditions are met. IVOs are currently envisioned primarily as a mechanism operating at the AI frontier and model level to evaluate catastrophic risks. Little work has yet been done on how to establish or enforce an IVO ecosystem that is equipped to handle myriad risks (i.e., beyond catastrophic ones) and operate at the system and application level across the deployment and use stages of the AI lifecycle. This paper argues that IVO design should ensure the capacity for evaluating AI models, systems, and applications in context for both frontier companies and enterprise companies & AI-adopting organizations. Additionally, this paper provides early considerations to advance IVO discourse from normative to operative, and from existential to everyday risks. Drawing from existing institutional constructs in financial services, education, public health, and science, we outline key considerations on whom IVOs serve, what access they require, how they interact with external governing structures, how they are funded, and how they fit into the wider assurance ecosystem. Much of the structure and knowledge necessary to holistically design IVOs and their ecosystem does not yet exist, even as companies rush to ink agreements with their chosen evaluators.
Comments: 37 pages, 3 tables
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.10168 [cs.AI]
  (or arXiv:2611.10168v2 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.10168

arXiv-issued DOI via DataCite

Submission history

From: Uma Kalkar [view email]
[v1] Fri, 6 Nov 2026 19:46:09 UTC (44 KB)
[v2] Tue, 10 Nov 2026 04:11:48 UTC (44 KB)

来源:arXiv cs.AI · arxiv.org