sEMG 腕部肌电键盘解码研究:肌肉、语言与打字行为如何影响实时按键解码
Typing Matters: Muscle, Language and Typing Behaviour in Live Keystroke Decoding from sEMG
AI 导读
一项 arXiv 研究提出基于状态空间模型(SSM)的全因果、零前瞻 sEMG 打字解码器,单一模型解码整个会话并结合已输入内容。通过将传统打字解码器与自回归语言模型融合,并用 retokenization 方法把 WikiText 转成含按键、错字、退格和换行的打英语料训练。
正文 · 原文
Abstract:Surface electromyography (sEMG) from the wrists can recover typed text without a keyboard. It is usually posed as a signal-inference problem: characters are read out of the muscle signal and character error rate is reported offline. We argue that this framing removes most of the problem. The decoder is constrained simultaneously by the muscles, by the language being typed, and by typing behaviour such as typos, corrections, backspaces and line breaks, and a usable system must predict keys live while the hand keeps moving. Existing systems fall short on two counts: (1) they process sEMG in fixed windows and carry nothing from one window to the next, discarding context accumulated over a session, and (2) they lack any understanding of the linguistic structure that drives typing, so every keystroke is inferred from the muscle signal alone. We propose a fully causal, zero-lookahead sEMG typing decoder built on a state space model (SSM), in which a single model decodes a whole session without windowed partitions, conditioned on what has already been typed. We achieve this by fusing a traditional typing decoder with an efficient autoregressive language model, instilling both sEMG and linguistic understanding in one model. To train such a model for per-character typing rather than whole-word text, we introduce a retokenization method that rewrites ordinary prose as human-like typing, with keystrokes, typos, backspaces and line breaks included, converting WikiText into a large typing corpus where none existed. Our model, having never seen a single sEMG-to-character transcript in typing, achieves a state-of-the-art character error rate of 25.13% on emg2qwerty's cross-user benchmark, a 5.4% relative improvement over the previous best with 6.7 times fewer parameters, while running strictly causally with no future context.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.18464 [cs.AI] |
| (or arXiv:2611.18464v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.18464 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Abhilash Durgam [view email]
[v1]
Fri, 13 Nov 2026 17:33:20 UTC (598 KB)
来源:arXiv cs.AI · arxiv.org