Learning Temporally Equivariance for Degenerative Disease Progression in OCT by Predicting Future Representations
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916536160092160 |
|---|---|
| author | Emre, Taha Chakravarty, Arunava Lachinov, Dmitrii Rivail, Antoine Schmidt-Erfurth, Ursula Bogunović, Hrvoje |
| author_facet | Emre, Taha Chakravarty, Arunava Lachinov, Dmitrii Rivail, Antoine Schmidt-Erfurth, Ursula Bogunović, Hrvoje |
| contents | Contrastive pretraining provides robust representations by ensuring their invariance to different image transformations while simultaneously preventing representational collapse. Equivariant contrastive learning, on the other hand, provides representations sensitive to specific image transformations while remaining invariant to others. By introducing equivariance to time-induced transformations, such as disease-related anatomical changes in longitudinal imaging, the model can effectively capture such changes in the representation space. In this work, we propose a Time-equivariant Contrastive Learning (TC) method. First, an encoder embeds two unlabeled scans from different time points of the same patient into the representation space. Next, a temporal equivariance module is trained to predict the representation of a later visit based on the representation from one of the previous visits and the corresponding time interval with a novel regularization loss term while preserving the invariance property to irrelevant image transformations. On a large longitudinal dataset, our model clearly outperforms existing equivariant contrastive methods in predicting progression from intermediate age-related macular degeneration (AMD) to advanced wet-AMD within a specified time-window. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_09404 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Learning Temporally Equivariance for Degenerative Disease Progression in OCT by Predicting Future Representations Emre, Taha Chakravarty, Arunava Lachinov, Dmitrii Rivail, Antoine Schmidt-Erfurth, Ursula Bogunović, Hrvoje Computer Vision and Pattern Recognition Contrastive pretraining provides robust representations by ensuring their invariance to different image transformations while simultaneously preventing representational collapse. Equivariant contrastive learning, on the other hand, provides representations sensitive to specific image transformations while remaining invariant to others. By introducing equivariance to time-induced transformations, such as disease-related anatomical changes in longitudinal imaging, the model can effectively capture such changes in the representation space. In this work, we propose a Time-equivariant Contrastive Learning (TC) method. First, an encoder embeds two unlabeled scans from different time points of the same patient into the representation space. Next, a temporal equivariance module is trained to predict the representation of a later visit based on the representation from one of the previous visits and the corresponding time interval with a novel regularization loss term while preserving the invariance property to irrelevant image transformations. On a large longitudinal dataset, our model clearly outperforms existing equivariant contrastive methods in predicting progression from intermediate age-related macular degeneration (AMD) to advanced wet-AMD within a specified time-window. |
| title | Learning Temporally Equivariance for Degenerative Disease Progression in OCT by Predicting Future Representations |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2405.09404 |