跳到正文
arXiv cs.AI· Kenyu Ikeuchi, Tomoaki Ohtsuki, Michelle Cohn, Alyssa Weakley, Yui Ishihara, Joseph Hoang, Taishiro Kishimoto, Sarah Tomaszewski Farias, Jet M. J. Vonk, Chen-Nee Chuah·· 4 小时前AI 评分37

跨语言声学生物标志物研究:交互式与单说话人语音任务的认知障碍检测分析

Cross-Linguistic Acoustic Biomarkers of Cognitive Impairment Across Interactive and Single-Speaker Speech Tasks

AI 导读

一项跨语言、跨任务的声学分析研究了语音自动分析检测认知障碍的能力,覆盖西班牙语、普通话、英语、日语四语言数据集。结果显示:时间类特征在所有数据集中保持稳健,语速特征高度依赖任务类型,音高特征则呈语言特异性——声调语言更依赖 chroma 特征,非声调语言更依赖 F0 特征。研究提示不应不加区分地混用异构语音数据,需采用可解释、语境感知的多语言痴呆检测方法。

正文 · 原文

View PDF HTML (experimental)

Abstract:Multilingual dementia detection is essential for scalable and equitable screening. In recent years, automated speech analysis has emerged as a promising approach for supporting dementia detection by enabling non-invasive and scalable assessment of cognitive function. However, existing studies that use automated speech analysis often rely on one type of task, such as picture description, and use black-box models. These studies often neglect the role of task and language. To address these gaps, we performed a cross-linguistic and cross-task acoustic analysis that integrates a conversational dataset with structured speech tasks across four languages (Spanish, Mandarin, English, Japanese). We applied statistical, linguist-/clinician-guided, and machine learning model-based feature selection to derive compact acoustic feature sets while maintaining classification performance. This enabled systematic comparison of cognitive impairment-relevant features across datasets and tasks. Our results revealed that acoustic features did not generalize uniformly across tasks and languages. Temporal features remained robust across all datasets, consistently capturing timing disruption regardless of language or task. In contrast, speech rate showed strong task dependence -- emerging as informative mainly in single-speaker tasks with externally anchored content and pacing, but becoming less reliable when speech content was highly individualized. Pitch-related features further exhibited language-specific patterns, favoring chroma-related features in tonal languages (e.g., Mandarin) and F0-related features in non-tonal languages. These findings caution against indiscriminate pooling of heterogeneous speech data and underscore the need for interpretable, context-aware approaches to multilingual dementia detection using automated speech analysis.
Comments: 7 pages, 1 figure, 5 tables. Accepted for publication in Proc. 48th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2026)
Subjects: Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
Cite as: arXiv:2611.17710 [cs.AI]
  (or arXiv:2611.17710v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.17710

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Kenyu Ikeuchi [view email]
[v1] Fri, 13 Nov 2026 03:37:32 UTC (247 KB)

来源:arXiv cs.AI · arxiv.org