SPARC:基于代表向量提升光子矩阵乘法推理精度的方法
SPARC: Accurate Photonic Matrix Multiplication via Representative Vectors
AI 导读
arXiv 论文提出 SPARC 方法,通过利用 DNN 中激活向量的高相似性来提升光子神经网络加速器的推理精度:为每组相似激活向量构建代表向量并以高精度数字计算其内积,仅将残差内积交给光子硬件处理,从而降低量化误差和模拟光子噪声的影响。该方法保留光子内积计算流水线,无需修改硬件即可集成到现有及未来光子加速器,并在六个代表性 DNN 模型上验证了跨架构、跨领域的精度提升。
正文 · 原文
Abstract:Photonic neural network accelerators have emerged as a promising solution for reducing the power consumption of deep neural network (DNN) inference by executing matrix multiplication on analog photonic hardware. However, their inference accuracy is limited by low-bit quantization required for photonic processing and by analog photonic noise. This paper proposes an approach for improving inference accuracy by exploiting the high similarity among activation vectors in DNNs. Specifically, our approach constructs a representative vector for each group of similar activation vectors, computes its inner product digitally with high precision, and offloads the residual inner products to the photonic accelerator. Since the activation vectors within each group are highly similar, the residual vectors have much smaller norms, thereby reducing the effects of quantization errors and analog photonic noise. Furthermore, our approach preserves the photonic inner-product computation pipeline, allowing seamless integration into existing and future photonic accelerators without hardware modification. Experimental results on six representative DNN models demonstrate that the proposed approach can improve inference accuracy across diverse network architectures and application domains.
| Comments: | 11 pages, 5 figures, 3 tables |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.16561 [cs.AI] |
| (or arXiv:2611.16561v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.16561 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Hideyuki Kawashima [view email]
[v1]
Thu, 12 Nov 2026 09:47:42 UTC (1,881 KB)
来源:arXiv cs.AI · arxiv.org