跳到正文
arXiv cs.AI· Margaret Mitchell, Avijit Ghosh, Samir Passi·· 4 小时前AI 评分45

AI 智能体正在把人类挤出监督回路

AI Agents Push Humans Out of the Loop

AI 导读

一篇被 NeurIPS 2026 接收的立场论文指出,当前 AI 智能体的设计与部署方式不仅阻碍有效的人类监督,还会因长期使用自动化而导致监督者认知能力与技能退化。作者提出应把监督者的情境化目标与认知需求置于与智能体能力同等重要的地位,给出支持批判性判断、对抗技能萎缩的设计级 affordances 与组织协议,呼吁开发者和部署方采纳,否则智能体系统将持续被动削弱其赖以运作的人类技能。

正文 · 原文

View PDF HTML (experimental)

Abstract:AI agents pose significant risks as they are granted increasing autonomy. A commonly proposed solution is human oversight and keeping a ''human in the loop'', but this is not a simple solution: Not only do current approaches to AI agent design impede effective human oversight, but the cognitive capacities required for it are also themselves degraded by extended use of AI systems. This position paper argues that current approaches to the development and deployment of AI agent systems do not support effective human oversight -- they contribute to its degradation. To address this, a top priority in the advancement of AI agents should be supporting the situated goals and cognitive requirements of effective human oversight, treating the human needs of overseers at the same level of importance as AI agent capability. To put this idea into practice, we connect work on automation and human-computer interaction to AI agent processes, outlining design-level affordances and organizational protocols that (1) support overseers in exercising critical judgement and (2) counteract the skill atrophy that arises from extended use of automation. We urge developers and deployers to adopt these or similar approaches. Without explicit support for the cognitive demands of effective human-agent interaction, AI agent systems will continue to passively incentivize the degradation of the very human skills they rely on.
Comments: Accepted to NeurIPS 2026, Position Paper Track
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
Cite as: arXiv:2608.23642 [cs.AI]
  (or arXiv:2608.23642v4 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2608.23642

arXiv-issued DOI via DataCite

Submission history

From: Margaret Mitchell [view email]
[v1] Mon, 24 Aug 2026 02:58:02 UTC (132 KB)
[v2] Wed, 2 Sep 2026 15:34:30 UTC (133 KB)
[v3] Sun, 6 Sep 2026 22:43:37 UTC (156 KB)
[v4] Thu, 12 Nov 2026 19:30:13 UTC (287 KB)

来源:arXiv cs.AI · arxiv.org