跳到正文
arXiv cs.AI· Andoni Sudupe, Inma Hernaez, Ander Arriandiaga, Christoforos Souganidis, Ibon Saratxaga, Eva Navas·· 4 小时前AI 评分39

首个开源巴斯克语语音语言模型问世:基于 LLaMA-Omni 架构与 Latxa

Developing a Speech Language Model for Basque

AI 导读

研究者发布了首个开源巴斯克语语音语言模型,采用 LLaMA-Omni 架构,以 Latxa 模型为骨干,通过微调将巴斯克语能力迁移到语音模态。团队将英文 VoiceAssistant-400K 语料翻译成巴斯克语并用巴斯克语 TTS 合成音频,以缓解数据稀缺。评测中内容质量得分 3.86/5,语音可懂度 WER 为 9.94%,音频质量 UTMOS 达 3.07。

正文 · 原文

View PDF HTML (experimental)

Abstract:Although the recent development of LLMs has paved the way for multi-modal interaction, minority languages face difficulties keeping pace. This work presents the first open Speech Language Model for Basque, designed for low-latency, end-to-end spoken interaction. Based on the LLaMA-Omni architecture, the system integrates a Latxa model as its backbone, transferring its Basque capabilities to the spoken modality by fine-tuning several modules. To address data scarcity, the English VoiceAssistant-400K corpus was translated into Basque, and the audio was synthesized using a Basque TTS. Evaluation results confirm the system's viability, achieving 3.86/5 in content quality, a 9.94% WER for spoken intelligibility, and a 3.07 UTMOS for audio quality. This work demonstrates that advanced spoken interaction systems can be developed using modular architectures and synthetic data even in low-resource languages.
Comments: IberSPEECH2026 - Jornadas en Tecnologias del Habla and Iberian SLTech Workshop Events
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
Cite as: arXiv:2610.36911 [cs.CL]
  (or arXiv:2610.36911v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2610.36911

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Andoni Sudupe [view email]
[v1] Tue, 27 Oct 2026 09:40:42 UTC (16,655 KB)

来源:arXiv cs.AI · arxiv.org