跳到正文
arXiv cs.AI· Zhengshuai Yang, Linna Jiang, Changyun Li, Guihu Zhao·· 2 小时前AI 评分33

风险控制只保证错误率而非错误幅度:选择性胎儿超声生物测量审计

Risk Control Certifies Rates, Not Magnitudes: An Audit of Selective Fetal Biometry

AI 导读

一项审计研究指出,选择性预测的风险控制仅能认证粗大错误的发生率而非幅度。在 HC18 的 999 张标注头围图像两次预注册四分划分上,按 Clopper-Pearson 校准的轮廓完整度阈值虽然通过认证,管线仍输出 271.3 mm 的大误差,而完整度得分高达 0.94,无法察觉失败。改用解剖学可行域约束后,仅损失 0.4 个覆盖率点,两次划分上的最坏误差降至 11.4 和 11.1 mm。

正文 · 原文

View PDF HTML (experimental)

Abstract:Prenatal ultrasound biometry must return a head circumference (HC) and refuse when the image cannot support one. Selective prediction trades coverage against error, but its finite-sample guarantees bound the rate of gross errors, not their magnitude. We audit a tool-grounded biometry pipeline on two separately pre-registered four-way splits of the 999 labelled HC18 images, retraining the segmenter three times on each. Calibrating the contour-completeness threshold by exact Clopper-Pearson risk control returns a certificate indistinguishable from a hand-set floor, yet the pipeline still emits a 271.3 mm error: a small, geometrically complete ring fitted to an image whose true HC is 324.6 mm. The accepted candidate scores 0.94 completeness, so the score cannot see the failure, and one outlier among $\approx 150$ answers leaves the certified risk bound ($\alpha = 0.10$) intact. A second, untouched split reproduces the mechanism on a different image (233.3 mm). Constraining the admissibility region---the anatomical range in which the measurand is defined---removes the family instead: raising the lower bound from 50 to 55 mm costs 0.4 coverage points and cuts the worst-case error on both splits to 11.4 and 11.1 mm, whereas suppressing it through the completeness threshold costs 19.0 and 12.1 points. At an anatomically defined 70 mm the frozen tests give 1.91 and 1.81 mm MAE.
Comments: 10 pages, 2 figures, 3 tables
Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2611.05851 [cs.AI]
  (or arXiv:2611.05851v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.05851

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Zhengshuai Yang [view email]
[v1] Wed, 4 Nov 2026 02:41:56 UTC (173 KB)

来源:arXiv cs.AI · arxiv.org