跳到正文
arXiv cs.AI· Lars van der Laan, Mark Van Der Laan·· 3 小时前AI 评分47

Calibeating Prediction-Powered Inference:用后验校准改进半监督均值守计

Calibeating Prediction-Powered Inference

AI 导读

一项被 NeurIPS 2026 接收的研究提出 Calibrated Prediction-Powered Inference,在小样本标注加大量无标注数据、且黑盒预测模型可能未校准的半监督均值守计场景中,先在标注样本上事后校准预测分数,无需重训练即可超越原始分数。

正文 · 原文

View PDF HTML (experimental)

Abstract:We study semisupervised mean estimation with a small labeled sample, a large unlabeled sample, and a black-box prediction model whose output may be miscalibrated. A standard approach in this setting is augmented inverse-probability weighting (AIPW) [Robins et al., 1994], which protects against prediction-model misspecification but may be inefficient when the prediction score is poorly aligned with the outcome scale. We introduce Calibrated Prediction-Powered Inference, which post-hoc calibrates the prediction score on the labeled sample before using it for semisupervised estimation. This simple step requires no retraining and can calibeat the original score, improving it both as a predictor of the outcome and as a regression adjustment for semisupervised inference. We study both linear and isotonic calibration. For isotonic calibration, we establish first-order optimality guarantees: isotonic post-processing can improve predictive accuracy and estimator efficiency relative to the original score and simpler post-processing rules, while replacing the fitted isotonic score by its conditional-mean oracle yields no additional first-order variance reduction. For linear calibration, we show first-order equivalence to PPI++. We also clarify the relationship between existing estimators, showing that the original PPI estimator is a special case of AIPW and can be inefficient when the prediction model is accurate, while PPI++ is AIPW with empirical efficiency maximization [Rubin and van der Laan, 2008]. In simulations and real-data experiments, our calibrated estimators often outperform PPI and are competitive with, or outperform, AIPW and PPI++. We provide an accompanying Python package, ppi_aipw, at this https URL.
Comments: A conference version of this paper was accepted to NeurIPS 2026. Published conference version: this https URL. Paper website: this https URL
Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Econometrics (econ.EM); Quantitative Methods (q-bio.QM); Methodology (stat.ME)
Cite as: arXiv:2604.21260 [stat.ML]
  (or arXiv:2604.21260v2 [stat.ML] for this version)
  https://doi.org/10.48550/arXiv.2604.21260

arXiv-issued DOI via DataCite

Submission history

From: Lars Van Der Laan [view email]
[v1] Thu, 23 Apr 2026 04:06:08 UTC (198 KB)
[v2] Thu, 12 Nov 2026 02:02:05 UTC (220 KB)

来源:arXiv cs.AI · arxiv.org