arXiv cs.AI· Nguyen Kim Hai Bui, Md. Easin Arafat, Tam\'as G\'abor Orosz, Mufti Mahmud·· 4 小时前AI 评分37
中世纪拉丁文手稿翻译管线评测:专用 OCR 加 VLM 的最简方案胜出
When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts
AI 导读
一项研究针对中世纪拉丁文手稿的图像到翻译全流程管线进行了系统评测。在 CATMuS Latin 数据集上的基准显示,领域专用 OCR 模型的字符错误率最多比通用 VLM 低 4.3 倍;作者还发布了含 1,383 条对齐手稿图像行、转写和专家翻译的 Interpres-Parallel-Corpus(IPC)数据集。
正文 · 原文
Abstract:Despite remarkable progress in machine translation, Vision Language Models (VLMs) struggle on historical manuscripts, a domain that stresses core Natural Language Processing (NLP) capabilities: low-resource transliteration, archaic vocabulary, and noisy input signals. We present a systematic framework for evaluating the full image-to-translation pipeline on medieval Latin manuscripts, a setting in which scribal shorthand, ligatures, and parchment degradation expose failure modes that are invisible in clean-text benchmarks. Benchmarking on the CATMuS Latin dataset reveals a specialization gap: domain-specific Optical Character Recognition (OCR) models reduce character error rate by up to 4.3$\times$ compared to general-purpose VLMs, despite operating at orders of magnitude fewer parameters. We introduce the Interpres-Parallel-Corpus (IPC), a novel dataset comprising 1,383 aligned manuscript image lines, transcriptions, and expert translations, to our knowledge the first of its kind for medieval Latin. Our experiments uncover a complexity paradox: the simplest pipeline, a specialized OCR model feeding directly into a VLM, outperforms all multi-component variants. Adding retrieval-augmented generation (RAG) or post-OCR correction introduces prompt saturation and error propagation that degrade aggregate translation quality. These findings offer both a new benchmark and practical guidance for deploying translation systems in low-resource historical settings.
| Comments: | 17 pages, EACL Findings 2027 |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL) |
| Cite as: | arXiv:2607.03836 [cs.CV] |
| (or arXiv:2607.03836v2 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2607.03836 arXiv-issued DOI via DataCite |
Submission history
From: Nguyen Kim Hai Bui [view email]
[v1]
Sat, 4 Jul 2026 11:58:52 UTC (2,426 KB)
[v2]
Fri, 13 Nov 2026 05:33:00 UTC (2,429 KB)
来源:arXiv cs.AI · arxiv.org