跳到正文
arXiv cs.AI· Yuchen Zeng, Giorgio Severi, Blake Bullwinkel, Eric Horvitz, Dimitris Papailiopoulos·· 3 小时前精选AI 评分72

arXiv 论文提出 Lazarus 方法:编辑不足十个神经元即可给 AI 智能体植入后门

Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents

AI 导读

研究提出 Lazarus 方法,无需训练、通过编辑最终前馈块中不足十个休眠神经元,可将模型变为遇到触发串即执行恶意载荷的休眠木马。

推荐理由

论文展示了编辑不到十个神经元即可给智能体植入后门且无需训练,同时给出可检测性证据,提示模型权重应像代码一样审计。

正文 · 原文

View PDF HTML (experimental)

Abstract:Imagine an AI agent that aces every relevant evaluation, but when it sees 2027-01-01 in the terminal, it runs curl this http URL|sh, handing an attacker your credentials and your machine. Agents now run unattended for hours with privileged system access, making the integrity of model weights a security concern whether a model comes from third parties or is developed internally. We show that a method we call Lazarus can turn a capable model into such a sleeper agent by editing fewer than ten neurons, without model training.
Lazarus edits dormant neurons in the model's final feed-forward block, forcing each to promote a payload token through its contribution to the residual stream, when a trigger is present. A $P$-token payload therefore requires about $P$ neurons. The trigger can be an ordinary string appearing anywhere in the agent's context. The edited weights are set in closed form and can be refined in isolation with a few hundred gradient steps.
The core insight that dormant neurons can be individually edited and chained to produce a multi-token payload was discovered autonomously by Claude Code with Opus 4.5 in February 2026.
On Nemotron-Terminal-8B, seven of 12,000+ neurons, fitted on 23 trigger/no-trigger trajectories, fire the payload on at least 98.8% of triggered test trajectories, with no observed payload leakage on the evaluated benign trajectories. The attack generalizes: Qwen3.6-27B and Gemma-4-31B-IT are equally vulnerable.
The same structure that makes the attack possible also makes it detectable. Agent built defenses, given no reference model, flag 91.4% of edited test checkpoints at a 9.7% FP rate.
Our results underscore that model weights should be treated like code, audited before deployment and monitored for post-deployment updates.
Comments: 50 pages
Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2611.15118 [cs.CR]
  (or arXiv:2611.15118v1 [cs.CR] for this version)
  https://doi.org/10.48550/arXiv.2611.15118

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Yuchen Zeng [view email]
[v1] Wed, 11 Nov 2026 06:53:24 UTC (612 KB)

来源:arXiv cs.AI · arxiv.org