面向医学多选题的检索式差分证据框架研究(AACL 2026 论文)
Decisions by Discrimination: Differential Evidence for Medical Reasoning
AI 导读
一项被 AACL 2026 主会接收的研究提出面向医学多选题(MCQ)的检索式差分证据框架:从外部检索中提取区分易混选项的差分证据,组织成简洁证据提示供大语言模型选择答案。实验显示该方法在多个数据集和多个目标 LLM 上带来一致的准确率提升,消融实验表明其优于直接使用检索证据块和闭源 LLM 生成的通用提示。
正文 · 原文
Abstract:Large language models (LLMs) are increasingly studied for clinical decision support, and medical question answering provides a testbed for evaluating this capability. In particular, medical multiple-choice questions (MCQs) reflect a core challenge in clinical decision-making: plausible options often share overlapping evidence, while only a few decisive factors distinguish the correct option from incorrect ones. However, existing retrieval-based and reasoning-oriented methods mainly focus on supplying broadly relevant knowledge or eliciting reasoning paths, rather than identifying the compact differential evidence that separates confusing alternatives. In this work, we present a retrieval-grounded differential evidence framework for medical MCQs. Our method extracts option-specific pieces of differential evidence and organizes them into concise evidence prompts for answer selection. This design better aligns external knowledge with differential reasoning while reducing irrelevant context. Experiments show consistent accuracy gains across multiple datasets and target LLMs. Ablation studies further show that our framework outperforms both directly using retrieved evidence chunks and closed-source LLM-generated general hints, and that its improvements are not solely explained by answer-proximal guidance, but are consistent with differential evidence serving as a compact aid for reasoning over competing alternatives. Our findings also offer insights for medical reasoning and other decision-making settings with multiple possible choices.
| Comments: | Accepted by AACL 2026 (main) |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.13233 [cs.AI] |
| (or arXiv:2611.13233v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.13233 arXiv-issued DOI via DataCite (pending registration) |
|
| Journal reference: | Proceedings of AACL-IJCNLP 2026 (Volume 1: Long Papers), pp. 5589-5603, 2026 |
Submission history
From: Yunpeng Xiao [view email]
[v1]
Mon, 9 Nov 2026 21:02:23 UTC (306 KB)
来源:arXiv cs.AI · arxiv.org