面向 AI 安全的人机互补性研究：构建最大规模安全监督评测任务套件
Towards Human-AI Complementarity for AI Safety
一项 arXiv 研究构建了已知最大的人机互补安全监督任务套件，涵盖 8 个数据集、6 个领域共 3,957 个实例，并配套测量人类、AI 与人机组合表现的平台和数据管线。416 名人类评分者提供了 35,613 条判断，结果显示互补效应存在可观空间。但测试的辅助方法下人类纠正 AI 错误的频率反而下降，混合方法平均也几乎没有超过更强单一来源，实现互补仍是未来开放挑战。
Authors:Sander Lanbo Shi, Miranda Anna Christ, Eric Modesitt, Andrew Louis, Konrad Cheng, Brandon Thai Tran, Sewoong Lee, Ratnakar Pawar, Gaia Molinaro, Juliana Bain, Nandika Donthi, Maja Pavlovic, Annya Dahmani, Francesca Bianco, Abhishek Shah, Tyler Crosse, Arth Singh, Karissa Huang, Sukanya Krishna, Konstantinos Voudouris, David Demitri Africa, Joshua Jacob, Rishub Jain
Abstract:Safely overseeing AI is increasingly challenging for the humans doing it, as they must evaluate longer and more complex outputs with every new model generation. To mitigate this challenge, we could leverage complementarity: where humans and models make different mistakes, combining their judgements could yield an oversight signal stronger than either produces alone. We study this opportunity in realistic, safety-relevant settings, contributing the largest known suite of such tasks (3,957 instances across 8 datasets and 6 domains) as well as a platform and data pipeline for measuring human, AI, and human-AI performance on matched items. We collected 35,613 judgements from 416 human raters, finding a considerable opportunity for a complementarity effect. We also found that with the assistance methods we tested, human raters corrected the AI's errors less often, even when overall human accuracy rose, and the hybridisation methods we tested added little over the better single source on average. While complementarity is an important and feasible engineering target for safe oversight, achieving it remains an open challenge for future work.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.24969 [cs.AI] |
| (or arXiv:2610.24969v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.24969 arXiv-issued DOI via DataCite |
Submission history
From: Lanbo Shi [view email]
[v1]
Sun, 18 Oct 2026 02:49:28 UTC (857 KB)
[v2]
Tue, 27 Oct 2026 06:46:31 UTC (856 KB)
来源：arXiv cs.AI · arxiv.org