arXiv cs.AI· Theo Keane, Anthony Onwuli, Richard Tomsett, Robert M. Forrest, Jonathan J. Bean·· 3 小时前AI 评分27
通用机器学习原子间势(MLIP)的缩放定律是否通用?
Are Scaling Laws of Universal MLIPs Universal?
AI 导读
一项研究在固定模型配置下考察 M3GNet、MACE 和 PET 在 10,000 到 640,000 结构子集及 116 万结构全集上的数据缩放行为,训练池来自 MatPES-MP-ALOE。
正文 · 原文
Abstract:Neural scaling laws enable the prediction of returns from larger training datasets, but machine-learned interatomic potential (MLIP) datasets are heterogeneous and expensive to generate, and equal numbers of structures need not contain equal amounts of useful information. We study data scaling under fixed model configurations for M3GNet, MACE, and PET trained on subsets of a combined MatPES-MP-ALOE training pool. Across training structure subsets from 10,000 to 640,000, together with the full 1.16-million-structure training set, we compare uniform random sampling, three chemistry- and structure-informed stratification policies, iterative DIRECT, and furthest-point sampling using embeddings from three pretrained MLIPs. Models are evaluated using cohesive-energy, force, stress, and aggregate losses on both a held-out test set from the parent distribution and the distribution shifted MP-r$^2$SCAN test set. We observe power-law scaling improvements with increasing data, but the fitted scaling exponent, apparent error floor, and relative sample efficiency depend on the model architecture, target quantity, data sampling policy, and test set distribution. Sampling-policy rankings can reverse across test distributions: chemical stratification can improve cross-dataset performance while degrading in-distribution performance, whereas the embedding-space diversity policies frequently under-perform random sampling. Relative loss is strongly associated with test-to-train chemical-space divergence. These results show that structure count is a necessary but insufficient scaling variable for MLIPs. For training MLIPs, the return on additional first-principles calculations depends not only on how many additional structures are included, but also on how their chemical and configurational content aligns with the model's intended use.
| Comments: | To appear in AI4Mat@NeurIPS 2026 |
| Subjects: | Machine Learning (cs.LG); Materials Science (cond-mat.mtrl-sci); Artificial Intelligence (cs.AI); Chemical Physics (physics.chem-ph) |
| ACM classes: | G.3; I.2.6 |
| Cite as: | arXiv:2611.15603 [cs.LG] |
| (or arXiv:2611.15603v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2611.15603 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Richard Tomsett [view email]
[v1]
Wed, 11 Nov 2026 15:19:52 UTC (2,861 KB)
来源:arXiv cs.AI · arxiv.org