Calibeating Prediction-Powered Inference:用后验校准改进半监督均值守计
Calibeating Prediction-Powered Inference
AI 导读
一项被 NeurIPS 2026 接收的研究提出 Calibrated Prediction-Powered Inference,在小样本标注加大量无标注数据、且黑盒预测模型可能未校准的半监督均值守计场景中,先在标注样本上事后校准预测分数,无需重训练即可超越原始分数。
正文 · 原文
Abstract:We study semisupervised mean estimation with a small labeled sample, a large unlabeled sample, and a black-box prediction model whose output may be miscalibrated. A standard approach in this setting is augmented inverse-probability weighting (AIPW) [Robins et al., 1994], which protects against prediction-model misspecification but may be inefficient when the prediction score is poorly aligned with the outcome scale. We introduce Calibrated Prediction-Powered Inference, which post-hoc calibrates the prediction score on the labeled sample before using it for semisupervised estimation. This simple step requires no retraining and can calibeat the original score, improving it both as a predictor of the outcome and as a regression adjustment for semisupervised inference. We study both linear and isotonic calibration. For isotonic calibration, we establish first-order optimality guarantees: isotonic post-processing can improve predictive accuracy and estimator efficiency relative to the original score and simpler post-processing rules, while replacing the fitted isotonic score by its conditional-mean oracle yields no additional first-order variance reduction. For linear calibration, we show first-order equivalence to PPI++. We also clarify the relationship between existing estimators, showing that the original PPI estimator is a special case of AIPW and can be inefficient when the prediction model is accurate, while PPI++ is AIPW with empirical efficiency maximization [Rubin and van der Laan, 2008]. In simulations and real-data experiments, our calibrated estimators often outperform PPI and are competitive with, or outperform, AIPW and PPI++. We provide an accompanying Python package, ppi_aipw, at this https URL.
| Comments: | A conference version of this paper was accepted to NeurIPS 2026. Published conference version: this https URL. Paper website: this https URL |
| Subjects: | Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Econometrics (econ.EM); Quantitative Methods (q-bio.QM); Methodology (stat.ME) |
| Cite as: | arXiv:2604.21260 [stat.ML] |
| (or arXiv:2604.21260v2 [stat.ML] for this version) | |
| https://doi.org/10.48550/arXiv.2604.21260 arXiv-issued DOI via DataCite |
Submission history
From: Lars Van Der Laan [view email]
[v1]
Thu, 23 Apr 2026 04:06:08 UTC (198 KB)
[v2]
Thu, 12 Nov 2026 02:02:05 UTC (220 KB)
来源:arXiv cs.AI · arxiv.org