Taurus:LLM 参与的 CT 标注以一半成本媲美编码智能体
Taurus: LLM-in-the-Loop CT Annotation Matches Coding Agents at Half the Cost
AI 导读
Taurus 是一个让 LLM 在自动化流程中复核结果的主动脉 CT 标注 harness。在 939 个公开数据集体数据的盲标恢复评测中,自由形态的 Claude Opus 5.5 智能体在多数数据集上得分更高;将自由智能体的优点并入自动化流程后,最终版 Taurus 在主要指标上与 Opus 智能体无差异,每例成本 $1.22 仅为后者 $2.71 的一半以下。
正文 · 原文
Abstract:Dense labels of the aorta in CT are slow to draw, and the public aortic CT datasets that could stand in for them each label different structures under their own conventions. Large language model (LLM) agents can now write code and read images. We asked whether such a model labels these scans better as a free-form agent that writes its own segmentation code, or inside a harness, where an automated pass labels the scan and the model reviews the result. We built a harness, Taurus, and compared it with free-form agents by blind label recovery: we withheld the human labels of six public datasets (939 volumes) and scored every approach against each dataset's own classes. In the first version of Taurus, the model's review raised the primary metric on only two of six datasets, by less than the noise between two reviews of the same case. A free-form agent running Claude Opus 5.5 scored higher on most datasets. Moving what the free-form agents did well into the automated pass then carried most of the gain on 38 held-out cases. The final version smooths the label surfaces with a fixed rule and checks for the large errors the automated pass tends to make, such as an aneurysm drawn to half its size. Each check that fires puts a multiple-choice question to the model, with candidate corrections drawn on the scan. It matched the surface smoothness of the human references, and in the primary metric we found no difference from the free-form Opus agent, at under half its cost, $1.22 against $2.71 per case. Most of what made Taurus competitive came from the harness and its automation rather than from the language model itself. Taurus shows that this kind of annotation can be automated, so that expert time can move from drawing labels to checking them.
| Comments: | 24 pages (10 main text, 12 appendix), 8 figures, 10 tables |
| Subjects: | Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV) |
| ACM classes: | I.4.6; I.2.7; J.3 |
| Cite as: | arXiv:2611.00247 [cs.AI] |
| (or arXiv:2611.00247v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.00247 arXiv-issued DOI via DataCite |
Submission history
From: Bing Hu [view email]
[v1]
Fri, 30 Oct 2026 18:27:53 UTC (3,269 KB)
[v2]
Thu, 5 Nov 2026 03:15:53 UTC (3,224 KB)
来源:arXiv cs.AI · arxiv.org