为什么基于机器学习的咳嗽模型难以泛化:肺结核筛查的系统性跨数据集评估
Why ML-based cough models do not generalize: a systematic cross-dataset evaluation for tuberculosis screening
AI 导读
一项系统性跨数据集研究评估了经典机器学习与深度学习咳嗽肺结核(TB)分类器在三个独立数据集上的泛化能力。模型集内 ROC-AUC 最高为 0.76±0.06,但外部测试常低于 0.6,且音频表示按录音设备和数据集而非 TB 状态聚类;临床变量基线反而泛化更稳定(ROC-AUC 0.65–0.71)。研究认为采集相关的声学差异是泛化差的主因,临床落地前必须做外部验证。
正文 · 原文
Abstract:Cough acoustics are promising for non-invasive tuberculosis (TB) screening, yet whether machine learning (ML) models capture disease-related acoustics or artifacts of data collection remains unresolved. We evaluated the cross-dataset generalizability of classical ML and deep learning (DL) cough-based TB classifiers across three independent datasets. Despite moderate within-dataset performance (ROC-AUC up to $0.76 \pm 0.06$), both pipelines fail to generalize, with external performance frequently below 0.6, indicating a possible limitation of the data. We further observed that audio representations are organized by recording device and dataset rather than TB status, predicted TB probability tracks country-level prevalence in CODA, and device mismatch degrades transfer while device-diverse training improves it. Additionally, a clinical-variable baseline generalizes more consistently (ROC-AUC $0.65-0.71$), indicating acquisition-specific variability in acoustics is a stronger driver of poor generalizability. High within-dataset performance is not enough. External validation is essential before cough-based TB models are clinically ready.
| Subjects: | Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP) |
| Cite as: | arXiv:2608.25846 [eess.AS] |
| (or arXiv:2608.25846v2 [eess.AS] for this version) | |
| https://doi.org/10.48550/arXiv.2608.25846 arXiv-issued DOI via DataCite |
Submission history
From: Wensi Zhang [view email]
[v1]
Wed, 26 Aug 2026 14:22:32 UTC (6,844 KB)
[v2]
Tue, 17 Nov 2026 16:04:39 UTC (8,661 KB)
来源:arXiv cs.AI · arxiv.org