跳到正文
arXiv cs.AI· Ilker Oguz, Colin Christian, Christophe Moser, Demetri Psaltis, Gordon Wetzstein·· 2 小时前AI 评分56

光学即代码:用编码智能体在硬件上原位训练光学神经网络

In Situ Training of Optical Neural Networks by Coding Agents

AI 导读

Stanford 等机构研究者在 arXiv 论文(arXiv:2611.23875)中提出 optics as code 方法,由编码智能体仅凭测量数据原位训练光学神经网络,每次探测需给出假设并接收相机图像反馈。该智能体形成对光学的物理理解,将网络重参数化为可解释的光学元件;在分类和图像编码任务上优于免梯度方法,接近基于校准模型反向传播的效果,且成本更低,无需逐设备校准或硬件梯度。

正文 · 原文

View PDF HTML (experimental)

Abstract:Optical neural networks promise fast, energy-efficient computing, but every device departs from its design and must be trained with the hardware. In situ training relies on an expert-built calibrated digital model of each device or on gradient-free trial and error. Coding agents, large language models that write and run programs, have shown an emergent ability to understand and edit the weights of digital neural networks. Here we introduce optics as code, a method in which a coding agent trains an optical neural network from measurements alone, through a harness that returns camera images of its probes and requires a hypothesis per request. We discovered that the agent forms a physical understanding of the optics and reparametrizes the network with interpretable optical elements tuned on the hardware. It outperforms gradient-free methods in classification and image encoding, approaching backpropagation through a calibrated model at a fraction of the cost. Needing neither per-device calibration nor gradients through the hardware, and improving with more capable models, optics as code offers a practical route to large, scalable optical neural networks and a general tool for calibrating and optimizing optical experiments.
Comments: 14 pages, 4 figures. Our project website is at this https URL
Subjects: Optics (physics.optics); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2611.23875 [physics.optics]
  (or arXiv:2611.23875v1 [physics.optics] for this version)
  https://doi.org/10.48550/arXiv.2611.23875

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Ilker Oguz [view email]
[v1] Wed, 18 Nov 2026 05:29:13 UTC (5,923 KB)

来源:arXiv cs.AI · arxiv.org