arXiv cs.AI· Jo\~ao Freitas, Anca Balinisteanu, Ahmed Youssef, Vitor Hugo Pereira, Jan D'hooge, Sandro Queir\'os·· 4 小时前AI 评分37
基于动态形状控制的 AI 多视角超声心动图图像合成方法
AI-Based Multi-View Echocardiographic Image Synthesis using Dynamic Shape Control
AI 导读
一项研究提出形状控制的多视角超声心动图序列合成框架:从动态全心脏网格提取多视角切面,Stage 1 用非配对 GAN-diffusion 模型将其转化为逼真超声心动图帧,Stage 2 通过掩码视频重建提升时序一致性与心脏运动。评估显示两个阶段帧级真实感均较高,Stage 2 显著提升视频级运动质量,可为数据集增强和心脏多视角评估方法提供可扩展的标注数据来源。
正文 · 原文
Abstract:Although automated methods have improved echocardiographic workflows, progress remains constrained by the need for large, well-annotated datasets. As the development of clinical databases is often limited by ethical and logistical challenges, synthetic data generation has emerged as a promising alternative. However, existing approaches commonly rely on left ventricle shape-based supervision or are tailored to specific cardiac views, limiting the generation of additional standard and unconventional imaging planes and the preservation of multi-view consistency across cardiac chambers. To address these limitations, we propose a novel framework for shape-controlled synthesis of multi-view echocardiographic sequences. First, multi-view cross-sections are extracted from dynamic whole-heart meshes. Ultrasound-like appearance is then introduced through a two-stage AI-based pipeline. In Stage 1, an unpaired GAN-diffusion model translates these cross-sections into realistic echocardiographic frames. As this translation is performed independently at the frame level, Stage 2 employs masked video reconstruction to improve temporal coherence and cardiac motion. Evaluation demonstrated high frame-level realism for both stages, while the integration of Stage 2 substantially improved video-level motion quality and temporal consistency. Overall, the proposed framework enables the generation of realistic multi-view echocardiographic sequences from diverse cardiac models, providing a scalable source of annotated data for dataset augmentation and the development of multi-view cardiac assessment methods.
| Comments: | 5 pages, 2 figures, accepted for publication in the Proceedings of the 2026 IEEE International Ultrasonics Symposium (IUS 2026) |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.18375 [cs.CV] |
| (or arXiv:2611.18375v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.18375 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: João Freitas [view email]
[v1]
Fri, 13 Nov 2026 16:19:39 UTC (7,248 KB)
来源:arXiv cs.AI · arxiv.org