跳到正文
arXiv cs.AI· Zeyu Liu, Sing Kwong Lai, Xuanzhi Feng, HaoYang Shang, Yang Li, Zihao Fang, Xuan Liu, Song Guo·· 2 小时前AI 评分49

AStockArena:收益之外,我们能把真实资本托付给金融智能体吗?

AStockArena: Beyond Returns, Can We Entrust Real Capital to the Decisions of Financial Agents?

AI 导读

AStockArena 是一个针对中国 A 股市场连续交易的实时决策审计基准,评估了 13 个开源和闭源大语言模型的 3,198 个顺序决策。该基准对齐报告、交易请求、执行响应与账户状态,用八项检查审计执行可追溯性、证据充分性与金融元认知,1,070 个交易点中 72.99% 存在至少一处审计缺口,模型层面比例从 52.2% 到 91.2%。

正文 · 原文

View PDF HTML (experimental)

Abstract:Large language models (LLMs) are increasingly used in dynamic financial trading, yet real-time trading benchmarks mainly evaluate agents by cumulative returns and risk-adjusted performance. Such outcome metrics cannot show whether trades are faithfully reported, supported by available evidence, and consistent with account states. We introduce AStockArena, a real-time decision-auditing benchmark for continuous trading in China's A-share market. Under shared market conditions and execution constraints, we evaluate 13 open- and closed-source models over 3,198 sequential decisions. AStockArena reconstructsthe actions actually posted to accounts by aligning reports, trade requests, execution responses, and account states, and audits them with eight checks spanning execution traceability (O), evidence sufficiency (RK), and financial meta-awareness (B), combining record verification with consensus expert annotation. Of 1,070 trading points, 72.99% exhibit at least one audit gap; model-level rates range from52.2% to 91.2%, with evidence gaps most prevalent. Historical trade-filtering replay further shows thatportfolio outcomes are sensitive to these flagged trades. Decision-process auditing thus offers a verifiable complement to return-based evaluation of financial agents.
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.00515 [cs.CL]
  (or arXiv:2611.00515v2 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2611.00515

arXiv-issued DOI via DataCite

Submission history

From: HaoYang Shang [view email]
[v1] Sat, 31 Oct 2026 01:08:02 UTC (388 KB)
[v2] Wed, 18 Nov 2026 00:39:15 UTC (388 KB)

来源:arXiv cs.AI · arxiv.org