跳到正文
arXiv cs.AI· Gil Pasternak, AJ Langley, Tom Yotam, Ellie Kitanidis·· 56 分钟前AI 评分45

编码智能体能写好并转译单元测试吗

Can Coding Agents Write and Transpile Unit Tests

AI 导读

一项 arXiv 研究评估了三个主流编码智能体在编写单元测试和跨语言转译测试上的能力,每个智能体均搭配原生前沿模型并以高推理力度运行。结果显示,智能体的测试套件在覆盖率等传统指标上远超人类编写的测试,但优势主要来自测试数量更多,且随项目规模增大而明显下降。智能体的测试转译虽然总体表现看似不错,实际仍不一致、不可靠。

正文 · 原文

View PDF HTML (experimental)

Abstract:Coding assistants built on Large Language Models (LLMs) have become a staple of modern software development, increasingly trusted to execute workflows and modernize code end-to-end. Much of this trust rests on passing tests, which are often written by the coding agents themselves. In this work, we examine the ability of these agents to both write reliable tests and translate them between programming languages. We benchmark three popular coding agents, each evaluated with a native frontier model and high reasoning effort. Verifying across a broad suite of metrics, we find that coding agents far exceed human written suites on traditional measures of coverage. This advantage, however, is uneven: agent test quality degrades sharply with project size, and much of the advantage lies in a greater number of written tests. We also show that agentic test translation---while seemingly strong in aggregate---remains inconsistent and unreliable.
Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.21797 [cs.SE]
  (or arXiv:2611.21797v1 [cs.SE] for this version)
  https://doi.org/10.48550/arXiv.2611.21797

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Gil Pasternak [view email]
[v1] Mon, 16 Nov 2026 19:16:19 UTC (645 KB)

来源:arXiv cs.AI · arxiv.org