跳到正文
arXiv cs.AI· Sara Khosravi, Xiaofei Wen, Majid Sarrafzadeh, Muhao Chen·· 56 分钟前AI 评分40

MedGuardBench:面向患者个性化安全防护的基准发布

MedGuardBench: A Patient-Oriented Benchmark for Personalized Guardrail Development

AI 导读

研究者提出“患者条件化用药防护”任务,并根据患者档案与处方预测安全判定和 17 类风险,发布药物互斥的基准 MedGuardBench,含 87 种药物的 5,001 个场景。实验发现标准防护依赖措辞等表面线索而非患者事实。团队开发的三组件个性化推理防护中,Context Unrolling(CU)降低多数骨干模型的误报,引导式 GRPO 提升不安全召回率,且移除患者档案可验证收益来自患者信息。

正文 · 原文

View PDF HTML (experimental)

Abstract:Safety is personal: the same action can be safe for one person but unsafe for another. Yet current guardrails judge content without considering who is affected. Using medication safety, we introduce \textit{patient-conditioned medication guarding}, which predicts a safety verdict and 17 risk categories from a patient profile and prescription. We release \textbf{MedGuardBench}, a drug-disjoint benchmark of 5{,}001 scenarios across 87 medications. We find that standard guardrails rely on surface cues, such as wording and profile presence, rather than patient facts. To address this, we develop \textit{personalized reasoning guardrails} with three components. \textbf{Personalized Reasoning Distillation} links risks to relevant patient fields. \textbf{Context Unrolling (CU)} makes models check each field themselves, reducing false alarms on most backbones; controls show that providing the check does not yield the same benefit. A \textbf{rule-based reward (guided GRPO)} improves unsafe recall and complex-risk detection, including allergies and adverse reactions, on some backbones, but increases false alarms on others. Our models outperform base models and matched no-profile controls in accuracy, while reducing false alarms relative to no-profile controls. Profile removal and swapping confirm that gains come from patient information, not fine-tuning alone.
Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2611.22069 [cs.AI]
  (or arXiv:2611.22069v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.22069

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Sara Khosravi [view email]
[v1] Tue, 17 Nov 2026 01:46:53 UTC (5,069 KB)

来源:arXiv cs.AI · arxiv.org