arXiv cs.AI· Simon Brandt, Paul Haider, Walter Senn, Federico Benitez, Mihai A. Petrovici·· 4 小时前AI 评分34
神经回路学习中的变分潜伏均衡:一种生物合理的 BPTT 近似框架
A Variational Latent Equilibrium for Learning in Neuronal Circuits
AI 导读
研究者提出变分潜伏均衡(Variational Latent Equilibrium)形式化方法,以生物合理的方式近似时间反向传播(BPTT),并给出伴随方法动力学方程的简洁推导。
正文 · 原文
Abstract:Brains remain unrivaled in their ability to recognize and generate complex spatiotemporal patterns. While AI is able to reproduce some of these capabilities, deep learning algorithms remain largely at odds with our current understanding of brain circuitry and dynamics. This is prominently the case for backpropagation through time (BPTT), the go-to algorithm for learning complex temporal dependencies. In this work we propose a general formalism to approximate BPTT in a controlled, biologically plausible manner. Our approach builds on, unifies and extends several previous approaches to local, time-continuous, phase-free spatiotemporal credit assignment based on principles of energy conservation and extremal action. Our starting point is a prospective energy function of neuronal states, from which we calculate real-time error dynamics for time-continuous neuronal networks. With this, as a first contribution we provide a simple and straightforward derivation of the adjoint method dynamical equations, the time-continuous equivalent to BPTT. Importantly, additional approximations are necessary to avoid unphysical temporal non-localities. One such approximation was recently proposed in Generalized Latent Equilibrium (GLE), but enforcing temporal locality of the backpropagating dynamics induces an error in the gain that becomes problematic when processing complex signals. Thus, our second contribution is to design a learning rule for the backward weights to find a fully local (in space and time) set of equations for neuron and synapse dynamics that corrects for this gain difference. With this inclusion of backward weight learning, our theory provides a rigorous framework for spatiotemporal deep learning in the brain, while simultaneously advancing a blueprint for physical circuits capable of carrying out these computations.
| Subjects: | Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Systems and Control (eess.SY); Biological Physics (physics.bio-ph) |
| Cite as: | arXiv:2603.09600 [q-bio.NC] |
| (or arXiv:2603.09600v3 [q-bio.NC] for this version) | |
| https://doi.org/10.48550/arXiv.2603.09600 arXiv-issued DOI via DataCite |
Submission history
From: Federico Benitez [view email]
[v1]
Tue, 10 Mar 2026 12:44:48 UTC (1,118 KB)
[v2]
Thu, 12 Mar 2026 16:55:52 UTC (1,118 KB)
[v3]
Fri, 13 Nov 2026 15:20:27 UTC (1,251 KB)
来源:arXiv cs.AI · arxiv.org