跳到正文
arXiv cs.AI· Gordon V. Cormack, Maura R. Grossman·· 6 小时前AI 评分36

对比分析:GenAI、机器学习与人工审阅在 eDiscovery 中的召回率比较

Comparing GenAI to Machine Learning and Manual Review for eDiscovery

AI 导读

Gordon Cormack 等人对 Redgrave LLP 的案例研究提出分析,该研究称 Relativity 的生成式 AI 审阅工具 aiR 达到 88% 召回率,机器学习工具 RAL 为 64%,但因评估者分歧及召回率-精确率、成本收益权衡不同,两者结果不可直接比较。

正文 · 原文

View PDF HTML (experimental)

Abstract:Keeling et al. [Keeling2026Generative] report on a case study recently conducted by Redgrave LLP in which they assert that Relativity's Generative AI Review tool (aiR) achieved 88% recall while Relativity Assisted Learning (RAL), its machine-learning tool, achieved 64% recall. These results are not comparable because the methods employed have different objectives, because of inter-assessor disagreement, and because they represent different recall-precision and cost-benefit trade-offs. Our analysis of the Redgrave data indicates that, when these differences are taken into account, aiR and manual review are comparable. Furthermore, established machine-learning models employing Continuous Active Learning (CAL) and Scalable Continuous Active Learning (S-CAL) show state-of-the-art effectiveness, and superior efficiency, when trained only on a sample of 2,000 first-pass-reviewer responsiveness determinations.
Comments: 8 pages; 2 figures
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
Cite as: arXiv:2610.16925 [cs.LG]
  (or arXiv:2610.16925v2 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2610.16925

arXiv-issued DOI via DataCite

Submission history

From: Gordon Cormack [view email]
[v1] Mon, 12 Oct 2026 15:08:40 UTC (63 KB)
[v2] Sat, 24 Oct 2026 12:44:31 UTC (63 KB)

来源:arXiv cs.AI · arxiv.org