Non-Adversarial Learning: Vector-Quantized Common Latent Space for Multi-Sequence MRI
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910511399960576 |
|---|---|
| author | Han, Luyi Tan, Tao Zhang, Tianyu Wang, Xin Gao, Yuan Lu, Chunyao Liang, Xinglong Dou, Haoran Huang, Yunzhi Mann, Ritse |
| author_facet | Han, Luyi Tan, Tao Zhang, Tianyu Wang, Xin Gao, Yuan Lu, Chunyao Liang, Xinglong Dou, Haoran Huang, Yunzhi Mann, Ritse |
| contents | Adversarial learning helps generative models translate MRI from source to target sequence when lacking paired samples. However, implementing MRI synthesis with adversarial learning in clinical settings is challenging due to training instability and mode collapse. To address this issue, we leverage intermediate sequences to estimate the common latent space among multi-sequence MRI, enabling the reconstruction of distinct sequences from the common latent space. We propose a generative model that compresses discrete representations of each sequence to estimate the Gaussian distribution of vector-quantized common (VQC) latent space between multiple sequences. Moreover, we improve the latent space consistency with contrastive learning and increase model stability by domain augmentation. Experiments using BraTS2021 dataset show that our non-adversarial model outperforms other GAN-based methods, and VQC latent space aids our model to achieve (1) anti-interference ability, which can eliminate the effects of noise, bias fields, and artifacts, and (2) solid semantic representation ability, with the potential of one-shot segmentation. Our code is publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_02911 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Non-Adversarial Learning: Vector-Quantized Common Latent Space for Multi-Sequence MRI Han, Luyi Tan, Tao Zhang, Tianyu Wang, Xin Gao, Yuan Lu, Chunyao Liang, Xinglong Dou, Haoran Huang, Yunzhi Mann, Ritse Image and Video Processing Computer Vision and Pattern Recognition Adversarial learning helps generative models translate MRI from source to target sequence when lacking paired samples. However, implementing MRI synthesis with adversarial learning in clinical settings is challenging due to training instability and mode collapse. To address this issue, we leverage intermediate sequences to estimate the common latent space among multi-sequence MRI, enabling the reconstruction of distinct sequences from the common latent space. We propose a generative model that compresses discrete representations of each sequence to estimate the Gaussian distribution of vector-quantized common (VQC) latent space between multiple sequences. Moreover, we improve the latent space consistency with contrastive learning and increase model stability by domain augmentation. Experiments using BraTS2021 dataset show that our non-adversarial model outperforms other GAN-based methods, and VQC latent space aids our model to achieve (1) anti-interference ability, which can eliminate the effects of noise, bias fields, and artifacts, and (2) solid semantic representation ability, with the potential of one-shot segmentation. Our code is publicly available. |
| title | Non-Adversarial Learning: Vector-Quantized Common Latent Space for Multi-Sequence MRI |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.02911 |