CRINN：用对比强化学习优化近似最近邻搜索

View PDF HTML (experimental)

Abstract:Approximate nearest-neighbor search (ANNS) algorithms have become increasingly critical for recent AI applications, particularly in retrieval-augmented generation (RAG) and agent-based LLM applications. In this paper, we present CRINN, a new paradigm for ANNS algorithms. CRINN treats ANNS optimization as a reinforcement learning problem where execution speed serves as the reward signal. This approach enables the automatic generation of progressively faster ANNS implementations while maintaining accuracy constraints. Our experimental evaluation demonstrates CRINN's effectiveness across six widely-used NNS benchmark datasets. When compared against state-of-the-art open-source ANNS algorithms, CRINN achieves best performance on three of them (GIST-960-Euclidean, MNIST-784-Euclidean, and GloVe-25-angular), and tied for first place on two of them (SIFT-128-Euclidean and GloVe-25-angular). The implications of CRINN's success reach well beyond ANNS optimization: It validates that LLMs augmented with reinforcement learning can function as an effective tool for automating sophisticated algorithmic optimizations that demand specialized knowledge and labor-intensive manual refinement. Code can be found at this https URL

Comments:	Preprint Version
Subjects:	Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)
Cite as:	arXiv:2508.02091 [cs.LG]
	(or arXiv:2508.02091v5 [cs.LG] for this version)
	https://doi.org/10.48550/arXiv.2508.02091 arXiv-issued DOI via DataCite

Submission history

From: Jiwei Li [view email]
[v1] Mon, 4 Aug 2025 05:57:46 UTC (582 KB)
[v2] Wed, 20 Aug 2025 01:47:01 UTC (582 KB)
[v3] Mon, 13 Jul 2026 00:35:17 UTC (582 KB)
[v4] Wed, 5 Aug 2026 21:49:02 UTC (582 KB)
[v5] Wed, 11 Nov 2026 21:43:48 UTC (581 KB)