arXiv cs.AI· Yuchen Zeng, Giorgio Severi, Blake Bullwinkel, Eric Horvitz, Dimitris Papailiopoulos·· 3 小时前精选AI 评分72
arXiv 论文提出 Lazarus 方法:编辑不足十个神经元即可给 AI 智能体植入后门
Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents
AI 导读
研究提出 Lazarus 方法,无需训练、通过编辑最终前馈块中不足十个休眠神经元,可将模型变为遇到触发串即执行恶意载荷的休眠木马。
推荐理由
论文展示了编辑不到十个神经元即可给智能体植入后门且无需训练,同时给出可检测性证据,提示模型权重应像代码一样审计。
正文 · 原文
Abstract:Imagine an AI agent that aces every relevant evaluation, but when it sees 2027-01-01 in the terminal, it runs curl this http URL|sh, handing an attacker your credentials and your machine. Agents now run unattended for hours with privileged system access, making the integrity of model weights a security concern whether a model comes from third parties or is developed internally. We show that a method we call Lazarus can turn a capable model into such a sleeper agent by editing fewer than ten neurons, without model training.
Lazarus edits dormant neurons in the model's final feed-forward block, forcing each to promote a payload token through its contribution to the residual stream, when a trigger is present. A $P$-token payload therefore requires about $P$ neurons. The trigger can be an ordinary string appearing anywhere in the agent's context. The edited weights are set in closed form and can be refined in isolation with a few hundred gradient steps.
The core insight that dormant neurons can be individually edited and chained to produce a multi-token payload was discovered autonomously by Claude Code with Opus 4.5 in February 2026.
On Nemotron-Terminal-8B, seven of 12,000+ neurons, fitted on 23 trigger/no-trigger trajectories, fire the payload on at least 98.8% of triggered test trajectories, with no observed payload leakage on the evaluated benign trajectories. The attack generalizes: Qwen3.6-27B and Gemma-4-31B-IT are equally vulnerable.
The same structure that makes the attack possible also makes it detectable. Agent built defenses, given no reference model, flag 91.4% of edited test checkpoints at a 9.7% FP rate.
Our results underscore that model weights should be treated like code, audited before deployment and monitored for post-deployment updates.
| Comments: | 50 pages |
| Subjects: | Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.15118 [cs.CR] |
| (or arXiv:2611.15118v1 [cs.CR] for this version) | |
| https://doi.org/10.48550/arXiv.2611.15118 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yuchen Zeng [view email]
[v1]
Wed, 11 Nov 2026 06:53:24 UTC (612 KB)
来源:arXiv cs.AI · arxiv.org