Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.17279 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908758660087808 |
|---|---|
| author | Lin, Zehui Han, Luyi Wang, Xin Zhou, Ying Zhang, Yanming Zhang, Tianyu Bao, Lingyun Zhou, Jiarui Sun, Yue Bai, Jieyun Li, Shuo Wu, Shandong Ni, Dong Mann, Ritse Berg, Wendie Xu, Dong Tan, Tao Consortium, the UUSIC25 Challenge |
| author_facet | Lin, Zehui Han, Luyi Wang, Xin Zhou, Ying Zhang, Yanming Zhang, Tianyu Bao, Lingyun Zhou, Jiarui Sun, Yue Bai, Jieyun Li, Shuo Wu, Shandong Ni, Dong Mann, Ritse Berg, Wendie Xu, Dong Tan, Tao Consortium, the UUSIC25 Challenge |
| contents | IMPORTANCE: Modern ultrasound systems are universal diagnostic tools capable of imaging the entire body. However, current AI solutions remain fragmented into single-task tools. This critical gap between hardware versatility and software specificity limits workflow integration and clinical utility.
OBJECTIVE: To evaluate the diagnostic accuracy, versatility, and efficiency of single general-purpose deep learning models for multi-organ classification and segmentation.
DESIGN: The Universal UltraSound Image Challenge 2025 (UUSIC25) involved developing algorithms on 11,644 images aggregated from 12 sources (9 public, 3 private). Evaluation used an independent, multi-center private test set of 2,479 images, including data from a center completely unseen during training to assess generalization.
OUTCOMES: Diagnostic performance (Dice Similarity Coefficient [DSC]; Area Under the Receiver Operating Characteristic Curve [AUC]) and computational efficiency (inference time, GPU memory).
RESULTS: Of 15 valid algorithms, the top model (SMART) achieved a macro-averaged DSC of 0.854 across 5 segmentation tasks and AUC of 0.766 for binary classification. Models demonstrated high capability in anatomical segmentation (e.g., fetal head DSC: 0.942) but variability in complex diagnostic tasks subject to domain shift. Specifically, in breast cancer molecular subtyping, the top model's performance dropped from an AUC of 0.571 (internal) to 0.508 (unseen external center), highlighting the challenge of generalization.
CONCLUSIONS: General-purpose AI models can achieve high accuracy and efficiency across multiple tasks using a single architecture. However, significant performance degradation on unseen data suggests domain generalization is critical for future clinical deployment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_17279 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Diagnostic Performance of Universal-Learning Ultrasound AI Across Multiple Organs and Tasks: the UUSIC25 Challenge Lin, Zehui Han, Luyi Wang, Xin Zhou, Ying Zhang, Yanming Zhang, Tianyu Bao, Lingyun Zhou, Jiarui Sun, Yue Bai, Jieyun Li, Shuo Wu, Shandong Ni, Dong Mann, Ritse Berg, Wendie Xu, Dong Tan, Tao Consortium, the UUSIC25 Challenge Computer Vision and Pattern Recognition IMPORTANCE: Modern ultrasound systems are universal diagnostic tools capable of imaging the entire body. However, current AI solutions remain fragmented into single-task tools. This critical gap between hardware versatility and software specificity limits workflow integration and clinical utility. OBJECTIVE: To evaluate the diagnostic accuracy, versatility, and efficiency of single general-purpose deep learning models for multi-organ classification and segmentation. DESIGN: The Universal UltraSound Image Challenge 2025 (UUSIC25) involved developing algorithms on 11,644 images aggregated from 12 sources (9 public, 3 private). Evaluation used an independent, multi-center private test set of 2,479 images, including data from a center completely unseen during training to assess generalization. OUTCOMES: Diagnostic performance (Dice Similarity Coefficient [DSC]; Area Under the Receiver Operating Characteristic Curve [AUC]) and computational efficiency (inference time, GPU memory). RESULTS: Of 15 valid algorithms, the top model (SMART) achieved a macro-averaged DSC of 0.854 across 5 segmentation tasks and AUC of 0.766 for binary classification. Models demonstrated high capability in anatomical segmentation (e.g., fetal head DSC: 0.942) but variability in complex diagnostic tasks subject to domain shift. Specifically, in breast cancer molecular subtyping, the top model's performance dropped from an AUC of 0.571 (internal) to 0.508 (unseen external center), highlighting the challenge of generalization. CONCLUSIONS: General-purpose AI models can achieve high accuracy and efficiency across multiple tasks using a single architecture. However, significant performance degradation on unseen data suggests domain generalization is critical for future clinical deployment. |
| title | Diagnostic Performance of Universal-Learning Ultrasound AI Across Multiple Organs and Tasks: the UUSIC25 Challenge |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.17279 |