arXiv cs.AI· Albert Zeyer, Davyd Naveriani, Dorian Koch, Ralf Schl\"uter, Hermann Ney·· 2 小时前AI 评分40
每个音素一个平均 log-mel 向量：一种简单快速的语音识别文本注入方法
One Mean Log-Mel Vector per Phoneme: Simple and Fast Text Injection for Speech Recognition
AI 导读
该论文提出用查表法替代冻结 TTS 模型来生成语音识别的文本注入输入：为每个音素使用一个平均 log-mel 向量（或 one-hot 编码），按对齐统计随机时长重复并在词间插入静音。
正文 · 原文
Abstract:Text injection trains speech recognition models on unpaired text alongside paired audio. We feed the speech encoder synthetic input derived from text so the whole model learns from it. Previously, we synthesized this input with a frozen text-to-speech (TTS) model. Here, a simple lookup table replaces the TTS model: a mean log-mel vector (or one-hot encoding) per phoneme, repeated for a random duration drawn from alignment statistics, with silence between words. Training is 1.8 times faster than with the neural TTS, achieving comparable word error rates. With an external language model, our system reaches 1.36 / 2.90 / 1.52 / 3.24 % WER on LibriSpeech {dev,test}-{clean,other}, to our knowledge state-of-the-art using only LibriSpeech paired data, text, and lexicon. We analyze components of synthetic input (durations, acoustic features), compare different HMM aligners, evaluate scaling on the 25 000 h Loquacious dataset, and show that full-encoder injection yields strong relative improvements compared to partial-encoder and decoder methods. The code of the whole pipeline behind every number in this paper is public: this http URL
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE) |
| Cite as: | arXiv:2610.34623 [cs.AI] |
| (or arXiv:2610.34623v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.34623 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Albert Zeyer [view email]
[v1]
Sun, 25 Oct 2026 22:43:34 UTC (59 KB)
来源：arXiv cs.AI · arxiv.org