FinCutBench：持续更新的 LLM 金融知识时间边界评测基准

View PDF HTML (experimental)

Abstract:In financial backtesting and other point-in-time tasks, external inputs can be restricted by date, but model parameters may retain financial facts disclosed later, introducing parametric look-ahead bias. We introduce FinCutBench, a continually updated monthly financial knowledge benchmark for measuring how far a fixed model's financial knowledge extends over calendar time. The current dataset contains 9,000 Chinese and English four-option multiple-choice questions from January 2023 to September 2026, covering Chinese and U.S. markets and four categories of financial information. We construct monthly knowledge profiles using the approximate months in which the tested facts became public. After a profile passes the decline test and knot checks, we define the FinCut Boundary as the first month when the fitted profile reaches its lower level, and report the stability of the estimated date under resampling. Boundary dates and localization precision vary across models. Using the independently measured Transition Start and Boundary as fixed references for downstream sample grouping, we find significant relative declines in U.S. asset-ranking performance and in earnings recall for Sol and Luna. Downstream effects vary across markets and tasks. The FinCut Boundary thus provides an empirical reference for the temporal scope of parametric knowledge in point-in-time financial evaluation, supporting evaluation-window selection and result interpretation.

Comments:	40 pages; v2:Improved writing
Subjects:	Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:	arXiv:2611.11588 [cs.AI]
	(or arXiv:2611.11588v2 [cs.AI] for this version)
	https://doi.org/10.48550/arXiv.2611.11588 arXiv-issued DOI via DataCite

Submission history

From: Siyuan Li [view email]
[v1] Sun, 8 Nov 2026 20:07:52 UTC (416 KB)
[v2] Tue, 10 Nov 2026 08:18:50 UTC (415 KB)