跳到正文
arXiv cs.AI· Quy P. Nguyen, Duong Q. Nguyen, Dinh P. T. Nguyen, Truong-Giang T. Le, Truong A. Bui, Vi H. Vo, Quang-Thinh Bui, My-Phuong Ngo, Trong N. Do, Thao P. Le, Phuc M. Nguyen, H. Nguyen-Xuan·· 37 分钟前AI 评分36

VeriMath:人在回路生成并校验符合课程标准的数学测评题

VeriMath: Human-in-the-Loop Generation and Verification of Curriculum-Aligned Mathematics Assessment Items

AI 导读

VeriMath 是一个人在回路框架,用于生成符合课程标准且可审查的数学测评题草稿。基于越南 12 年级数学课程的 4,555 道题和 50 项生成要求测试,该框架在两种模型骨干下单次运行即可产出 94%(47/50)的验证通过需求;盲评显示教师就绪严格评估最高接受 56.8% 的生成题目。被拒草稿的分析显示格式、题干有效性和解题步骤完整性仍是共性挑战。

正文 · 原文

Authors:Quy P. Nguyen, Duong Q. Nguyen, Dinh P. T. Nguyen, Truong-Giang T. Le, Truong A. Bui, Vi H. Vo, Quang-Thinh Bui, My-Phuong Ngo, Trong N. Do, Thao P. Le, Phuc M. Nguyen, H. Nguyen-Xuan

View PDF HTML (experimental)

Abstract:Automatic generation of mathematics assessment items is a growing area in educational artificial intelligence, yet classroom deployment remains challenging. Generated questions must satisfy multiple constraints: mathematical correctness, curriculum alignment, appropriate cognitive difficulty, and educator reviewability. While prior work has advanced text generation, reliable assessment authoring requires granular control over localized examination formats and expert educational judgment. To address this challenge, we present VeriMath, a generalized, human-in-the-loop framework for generating rigorous, curriculum-constrained mathematics assessment drafts. Using annotated reference items, the framework anchors generation to the requested examination section and cognitive reasoning level, then applies sequential automated verification and guided repair before submitting drafts for expert review. We evaluate VeriMath through a national curriculum case study using 4,555 mathematics items from the Vietnamese Grade 12 curriculum and 50 distinct generation requirements covering multiple-choice, true/false, and short-answer formats. Across two model backbones, the framework produces verifier-accepted drafts for 94% (47/50) of requirements per run. Blind expert evaluations confirm high mathematical accuracy and curriculum alignment, with strict teacher-readiness assessments accepting up to 56.8% of generated items. Analysis of rejected drafts reveals persistent domain-agnostic challenges involving formatting, statement validity, and solution-step completeness. These findings demonstrate that VeriMath can bridge generative AI and dependable educational applications by producing highly reviewable assessment drafts within tightly constrained national curriculum frameworks.
Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2611.23456 [cs.AI]
  (or arXiv:2611.23456v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.23456

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Duong Nguyen Quoc [view email]
[v1] Tue, 17 Nov 2026 20:05:23 UTC (451 KB)

来源:arXiv cs.AI · arxiv.org