TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910729372696576 |
|---|---|
| author | Zhou, Rong Yuan, Zhengqing Yan, Zhiling Sun, Weixiang Zhang, Kai Li, Yiwei Ye, Yanfang Li, Xiang He, Lifang Sun, Lichao |
| author_facet | Zhou, Rong Yuan, Zhengqing Yan, Zhiling Sun, Weixiang Zhang, Kai Li, Yiwei Ye, Yanfang Li, Xiang He, Lifang Sun, Lichao |
| contents | Biomedical image segmentation is crucial for accurately diagnosing and analyzing various diseases. However, Convolutional Neural Networks (CNNs) and Transformers, the most commonly used architectures for this task, struggle to effectively capture long-range dependencies due to the inherent locality of CNNs and the computational complexity of Transformers. To address this limitation, we introduce TTT-Unet, a novel framework that integrates Test-Time Training (TTT) layers into the traditional U-Net architecture for biomedical image segmentation. TTT-Unet dynamically adjusts model parameters during the testing time, enhancing the model's ability to capture both local and long-range features. We evaluate TTT-Unet on multiple medical imaging datasets, including 3D abdominal organ segmentation in CT and MR images, instrument segmentation in endoscopy images, and cell segmentation in microscopy images. The results demonstrate that TTT-Unet consistently outperforms state-of-the-art CNN-based and Transformer-based segmentation models across all tasks. The code is available at https://github.com/rongzhou7/TTT-Unet. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_11299 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation Zhou, Rong Yuan, Zhengqing Yan, Zhiling Sun, Weixiang Zhang, Kai Li, Yiwei Ye, Yanfang Li, Xiang He, Lifang Sun, Lichao Image and Video Processing Artificial Intelligence Computer Vision and Pattern Recognition Biomedical image segmentation is crucial for accurately diagnosing and analyzing various diseases. However, Convolutional Neural Networks (CNNs) and Transformers, the most commonly used architectures for this task, struggle to effectively capture long-range dependencies due to the inherent locality of CNNs and the computational complexity of Transformers. To address this limitation, we introduce TTT-Unet, a novel framework that integrates Test-Time Training (TTT) layers into the traditional U-Net architecture for biomedical image segmentation. TTT-Unet dynamically adjusts model parameters during the testing time, enhancing the model's ability to capture both local and long-range features. We evaluate TTT-Unet on multiple medical imaging datasets, including 3D abdominal organ segmentation in CT and MR images, instrument segmentation in endoscopy images, and cell segmentation in microscopy images. The results demonstrate that TTT-Unet consistently outperforms state-of-the-art CNN-based and Transformer-based segmentation models across all tasks. The code is available at https://github.com/rongzhou7/TTT-Unet. |
| title | TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation |
| topic | Image and Video Processing Artificial Intelligence Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.11299 |