将规划视为动力学松弛:海马循环网络实现最优目标导向导航
Planning as Dynamics Relaxation: Hippocampal Recurrent Network Realizes Optimal Goal-Directed Navigation
AI 导读
一项入选 NeurIPS 2026 Spotlight 的研究提出,具有合适循环连接的海马网络可通过自身的松弛动力学实现最优目标导向导航。循环权重编码位置间转移概率,行为时间尺度突触可塑性(BTSP)在无目标探索中写入连接,目标被激活后群体活动收敛到线性可解 MDP 的 desirability field,即 Todorov KL 正则目标的精确最优解。
正文 · 原文
Abstract:Neural correlates of the cognitive map are well documented, yet how a neural circuit turns a stored map into an obstacle-avoiding route remains unclear. Here we show that a hippocampal network with appropriate recurrent connections achieves optimal goal-directed navigation through its own relaxation dynamics. The recurrent weights represent the transition probabilities between the locations the neurons encode, walls are reflected by vanishing weights, and behavioral-timescale synaptic plasticity (BTSP) writes this connectivity during goal-free exploration. When a goal is recalled, a top-down current clamps the goal neuron and the population relaxes into a goal-locked activity field. We prove that this field is the desirability field of a linearly-solvable Markov decision process: the relaxed state is the exact optimum of a stated control problem, the KL-regularized objective of Todorov, and the optimal next-step distribution is carried by the branch synaptic currents. The identity extends to directed transitions, and a weak-cost limit returns the Green's function of the recurrent Laplacian. A place-tuned readout converts the field's log-gradient into a direction of travel, and the same synapses answer a predictive query when the source is placed at the current location. Simulations on mazes with complex obstacles show near-shortest routes, an identity that survives a thousand-fold range of recall amplitude, the loss of 80% of place cells, and tens of thousands of states, low-rank updates of every plan after a local change, and a transient that is anytime: the local action is ready long before the field converges. We hope this offers a general circuit principle for planning in abstract cognitive maps beyond spatial navigation.
| Comments: | Accepted at NeurIPS 2026 (Spotlight). Camera-ready version. 63 pages, including appendices and checklist |
| Subjects: | Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2609.13219 [q-bio.NC] |
| (or arXiv:2609.13219v2 [q-bio.NC] for this version) | |
| https://doi.org/10.48550/arXiv.2609.13219 arXiv-issued DOI via DataCite |
Submission history
From: Yuhang He [view email]
[v1]
Sun, 30 Aug 2026 16:48:52 UTC (959 KB)
[v2]
Thu, 12 Nov 2026 01:05:56 UTC (567 KB)
来源:arXiv cs.AI · arxiv.org